00000001:02000400:2.0F:1784045032.140548:0:2973:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1784045053.754113:0:3194:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1784045055.458901:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 587 MB/s 00000001:01000000:2.0:1784045055.712803:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 426 MB/s 00000001:01000000:2.0:1784045055.961988:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3831 MB/s 00000020:02000000:1.0:1784045056.676007:0:3286:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g336b9c0 00000400:02000000:2.0:1784045057.516632:0:3301:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.158@tcp [8/256/0/180] 00008000:02000000:2.0:1784045061.028032:0:3451:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1784045114.461319:0:5257:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784045123.742814:0:5785:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784045123.742821:0:5785:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0F:1784045123.743142:0:5785:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000009354089b 00000080:02000400:3.0:1784045123.743164:0:5785:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784045123.746910:0:5785:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784045123.746929:0:5785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784045123.746970:0:5785:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007d182fea) 00000020:00000080:3.0:1784045123.746994:0:5785:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784045123.762010:0:5785:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784045123.763140:0:5785:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784045123.795336:0:5785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784045123.795418:0:5785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784045123.795434:0:5785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784045123.795464:0:5785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784045123.795478:0:5785:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784045123.796307:0:5785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784045123.796315:0:5785:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784045123.796325:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2c9b7 00000020:01000004:3.0:1784045123.796331:0:5785:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784045123.796336:0:5785:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784045123.796340:0:5785:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009354089b from MGS 00000020:01000004:3.0:1784045123.796344:0:5785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784045123.796351:0:5785:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000799df2b7) 00000020:00000080:3.0:1784045123.796412:0:5785:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784045123.797001:0:5785:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009354089b from MGS, refs=2 00080000:01000000:3.0:1784045123.797008:0:5785:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045123.797018:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2c9c5 00000100:00100000:3.0:1784045123.797235:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784045123.797341:0:5785:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784045123.797345:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784045123.798053:0:5785:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784045123.798059:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784045123.798794:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045123.798955:0:5785:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784045123.798958:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784045123.800072:0:5785:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784045123.800084:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784045123.800750:0:5785:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784045123.800757:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784045123.802221:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045123.802226:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045123.802228:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045123.802704:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045123.802708:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045123.802710:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045123.803768:0:5785:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784045123.806302:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784045124.052931:0:5785:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2255 MB/s 00000001:01000000:3.0:1784045124.302974:0:5785:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3299 MB/s 00000001:01000000:3.0:1784045124.553788:0:5785:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 547 MB/s 00000001:01000000:2.0:1784045124.806538:0:5785:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 529 MB/s 00080000:10000000:2.0:1784045124.823186:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1784045124.834855:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784045124.856388:0:5785:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784045124.856407:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784045124.856411:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1784045124.863505:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784045124.863591:0:5785:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784045124.863664:0:5785:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1784045124.864000:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784045124.864032:0:5785:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784045124.864350:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045124.864520:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784045124.864526:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784045124.868341:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784045124.868354:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784045124.880629:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784045124.880645:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784045124.883767:0:5785:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784045124.883792:0:5785:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.158@tcp' 00000020:01000004:3.0:1784045124.883794:0:5785:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784045124.883869:0:5785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.158@tcp (typ=mgc) 00000100:00080000:1.0:1784045124.884039:0:5800:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1784045124.884073:0:5785:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.158@tcp (00000000805b1d24) 00000020:00000080:3.0:1784045124.884093:0:5785:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784045124.884185:0:5785:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000219fa598@MGC192.168.201.158@tcp: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1784045124.884361:0:5785:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.158@tcp-0 is initialized 00000040:01000000:3.0:1784045124.884369:0:5785:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 1 is initialized 10000000:01000000:1.0:1784045124.901763:0:5801:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1784045124.902222:0:5785:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.158@tcp (uuid fa48aca7-8b52-46ad-960b-10d4ed6c2d8b) 00000020:00000080:0.0:1784045124.902253:0:5785:0:(genops.c:1406:class_connect()) connect: client fa48aca7-8b52-46ad-960b-10d4ed6c2d8b, cookie 0xdb5b5ff6a2d2c9d3 00000100:00080000:0.0:1784045124.902280:0:5785:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045124.902286:0:5785:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import 00000000219fa598 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045124.902352:0:5785:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008aa71848 x1870706829688960/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045124.902385:0:5785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fa48aca7-8b52-46ad-960b-10d4ed6c2d8b->MGS 00000020:01000004:0.0:1784045124.902409:0:5785:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784045124.902415:0:5785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784045124.902435:0:5785:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b25de4c2) 00000020:00000080:0.0:1784045124.902450:0:5785:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784045124.902933:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008aa71848 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3317:1870706829688960:0@lo:250: 00000100:00100000:1.0:1784045124.903036:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045124.905740:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829688960 00000100:00100000:2.0:1784045124.905763:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829688960 00000100:00100000:2.0:1784045124.905824:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045124.905863:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050c63df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3317:x1870706829688960:12345-0@lo:250: 00010000:00080000:2.0:1784045124.907436:0:5796:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fa48aca7-8b52-46ad-960b-10d4ed6c2d8b@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1784045124.907482:0:5796:0:(genops.c:1406:class_connect()) connect: client fa48aca7-8b52-46ad-960b-10d4ed6c2d8b, cookie 0xdb5b5ff6a2d2c9e1 00000100:00080000:2.0:1784045124.911597:0:5796:0:(import.c:65:import_set_state_nolock()) 0000000018b0814d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045124.911732:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050c63df5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:3317:x1870706829688960:12345-0@lo:250: Request processed in 5865us (8692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045124.911745:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045124.916598:0:3317:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1784045124.916618:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.158@tcp: connect to target with instance 0 00000100:00080000:1.0:1784045124.916629:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784045124.916636:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784045124.916642:0:3317:0:(import.c:65:import_set_state_nolock()) 00000000219fa598 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784045124.916647:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784045124.916660:0:3317:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784045124.916669:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008aa71848 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3317:1870706829688960:0@lo:250: 00000100:00100000:0.0:1784045124.925149:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045124.925370:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784045124.925377:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784045124.926367:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784045124.926379:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784045124.933029:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784045124.933046:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784045124.937255:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045124.937465:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784045124.937472:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784045124.938376:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784045124.938387:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784045125.005634:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045125.010508:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784045125.010518:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784045125.013151:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784045125.013182:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784045125.013980:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045125.014156:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784045125.014161:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784045125.025314:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784045125.025334:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784045125.029752:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045125.029989:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784045125.029996:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784045125.034500:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045125.034522:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1784045125.039087:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045125.039304:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784045125.039310:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784045125.055697:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045125.055718:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784045125.110432:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045125.110662:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784045125.110669:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784045125.118412:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045125.118434:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784045125.120141:0:5785:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784045125.120164:0:5785:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784045125.120780:0:5785:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784045125.120804:0:5785:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784045125.120810:0:5785:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784045125.121110:0:5785:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784045125.121148:0:5785:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784045125.121153:0:5785:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784045125.121155:0:5785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045125.121157:0:5785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045125.121158:0:5785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045125.121159:0:5785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045125.121160:0:5785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045125.121161:0:5785:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045125.121163:0:5785:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045125.121165:0:5785:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045125.121166:0:5785:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045125.121168:0:5785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045125.121169:0:5785:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784045125.121172:0:5785:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784045125.121175:0:5785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784045125.121176:0:5785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045125.121177:0:5785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045125.121178:0:5785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045125.121179:0:5785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045125.121180:0:5785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045125.121181:0:5785:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045125.121182:0:5785:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045125.121182:0:5785:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045125.121183:0:5785:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045125.121184:0:5785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045125.121185:0:5785:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784045125.121235:0:5785:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784045125.121266:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001b5e3e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689088:0@lo:253: 00000100:00100000:2.0:1784045125.121352:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045125.121469:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000033a7b07c going to sleep for 11 seconds 00000100:00100000:0.0:1784045125.125230:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689088 00000100:00100000:0.0:1784045125.125252:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689088 00000100:00100000:0.0:1784045125.125363:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045125.125373:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006be15c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:5785:x1870706829689088:12345-0@lo:253: 20000000:01000000:0.0:1784045125.125441:0:5799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784045125.125444:0:5799:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1784045125.128008:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784045125.128105:0:5799:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784045125.128436:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045125.130706:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784045125.131136:0:5799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784045125.131141:0:5799:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784045125.131147:0:5799:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784045125.131150:0:5799:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784045125.131164:0:5799:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784045125.131437:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045125.131658:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784045125.131672:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784045125.131725:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784045125.131792:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784045125.131882:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784045125.131987:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784045125.131997:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784045125.132044:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784045125.132052:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784045125.132085:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784045125.132092:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784045125.132121:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784045125.132172:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784045125.132205:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784045125.132211:0:5799:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784045125.132224:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045125.132446:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784045125.132456:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784045125.132498:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784045125.132532:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784045125.132578:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784045125.132590:0:5799:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784045125.132669:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784045125.132678:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784045125.132722:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784045125.132760:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784045125.132797:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784045125.132807:0:5799:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784045125.132927:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784045125.132937:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784045125.132970:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784045125.133004:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784045125.133161:0:5799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784045125.133205:0:5799:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784045125.133212:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1784045125.143287:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784045125.146447:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784045125.146490:0:5799:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.158@tcp for mdt 20000000:01000000:2.0:1784045125.146493:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:2.0:1784045125.146531:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784045125.146540:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784045125.146572:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784045125.146579:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:2.0:1784045125.146624:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784045125.146636:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784045125.146669:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784045125.146726:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784045125.146795:0:5799:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784045125.146798:0:5799:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784045125.146801:0:5799:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784045125.146813:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784045125.146816:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784045125.146932:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784045125.146934:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784045125.148417:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1784045125.149484:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1784045125.149536:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1784045125.149610:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1784045125.149627:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784045125.149630:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784045125.150738:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1784045125.151438:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1784045125.151504:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1784045125.151542:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1784045125.151559:0:5799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045125.151561:0:5799:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1784045125.151567:0:5799:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784045125.151569:0:5799:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784045125.152262:0:5799:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1784045125.152271:0:5799:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1784045125.156978:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1784045125.157510:0:5799:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784045125.175475:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1784045125.175538:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784045125.182141:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784045125.182197:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784045125.182222:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182243:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182264:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182271:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182292:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182299:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182306:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c61ab1c4 already unused, calling callback (00000000af526bde) 00010000:00010000:3.0:1784045125.182310:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182318:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182334:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182342:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045125.182347:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c61ab1c4/0xdb5b5ff6a2d2c9e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784045125.182369:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784045125.503346:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006be15c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:5785:x1870706829689088:12345-0@lo:253: Request processed in 377964us (381984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045125.503364:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045125.503463:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001b5e3e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689088:0@lo:253: 10000000:01000000:0.0:1784045125.503481:0:5785:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784045125.503484:0:5785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045125.503486:0:5785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045125.503487:0:5785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045125.503489:0:5785:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784045125.503490:0:5785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045125.503491:0:5785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045125.503493:0:5785:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045125.503494:0:5785:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045125.503496:0:5785:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784045125.503569:0:5785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045125.503571:0:5785:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784045125.503622:0:5785:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009354089b from lustre-MDT0000 10000000:01000000:0.0:1784045125.503651:0:5785:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784045125.503655:0:5785:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784045125.503660:0:5785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8aa907f44d40 10000000:01000000:0.0:1784045125.503664:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045125.503673:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa907f44d40 from 1 10000000:01000000:0.0:1784045125.503676:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045125.503722:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.503732:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.503741:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045125.503761:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689216:0@lo:101: 00000100:00100000:0.0:1784045125.503800:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045125.504028:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015c3e516 going to sleep for 11 seconds 00000100:00100000:2.0:1784045125.504140:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689216 00000100:00100000:2.0:1784045125.504149:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689216 00000100:00100000:2.0:1784045125.504195:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045125.504203:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014719c99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:5785:x1870706829689216:12345-0@lo:101: 00010000:00010000:2.0:1784045125.504227:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045125.504243:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c88764ea/0xdb5b5ff6a2d2c9f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2c9ef expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.504281:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c88764ea/0xdb5b5ff6a2d2c9f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.504292:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c88764ea/0xdb5b5ff6a2d2c9f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.504302:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c88764ea, rc 0) 00000100:00100000:2.0:1784045125.504347:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014719c99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:5785:x1870706829689216:12345-0@lo:101: Request processed in 145us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045125.504354:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045125.504443:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689216:0@lo:101: 00010000:00010000:0.0:1784045125.504457:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.504467:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045125.504598:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689344:0@lo:501: 00000100:00100000:0.0:1784045125.504626:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045125.504646:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015c3e516 going to sleep for 11 seconds 00000100:00100000:2.0:1784045125.504700:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689344 00000100:00100000:2.0:1784045125.504705:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689344 00000100:00100000:2.0:1784045125.504738:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045125.504744:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b283c117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:5785:x1870706829689344:12345-0@lo:501: 00000100:00100000:2.0:1784045125.505181:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b283c117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:5785:x1870706829689344:12345-0@lo:501: Request processed in 436us (554us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045125.505189:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045125.505276:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689344:0@lo:501: 10000000:01000000:0.0:1784045125.505308:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784045125.505367:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.505376:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 000000005f266ddf/0xdb5b5ff6a2d2c9ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045125.505385:0:5785:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa90538d800 10000000:01000000:0.0:1784045125.505391:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784045125.505394:0:5785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8aa90538d800 10000000:01000000:0.0:1784045125.505396:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784045125.505399:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8aa90538d800 from 1 10000000:01000000:0.0:1784045125.505401:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784045125.505425:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.505432:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.505449:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045125.505463:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689472:0@lo:101: 00000100:00100000:0.0:1784045125.505490:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045125.505625:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689472 00000100:00100000:2.0:1784045125.505630:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689472 00000100:00100000:2.0:1784045125.505659:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045125.505665:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000599f44f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:5785:x1870706829689472:12345-0@lo:101: 00010000:00010000:2.0:1784045125.505674:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045125.505688:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000381b1313/0xdb5b5ff6a2d2ca04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2c9fd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.505718:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000381b1313/0xdb5b5ff6a2d2ca04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2c9fd expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.505728:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000381b1313/0xdb5b5ff6a2d2ca04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2c9fd expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.505737:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000381b1313, rc 0) 00000100:00100000:2.0:1784045125.505763:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000599f44f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+7:5785:x1870706829689472:12345-0@lo:101: Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045125.505770:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045125.505988:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015c3e516 going to sleep for 11 seconds 00000100:00100000:0.0:1784045125.506004:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689472:0@lo:101: 00010000:00010000:0.0:1784045125.506014:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.506022:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045125.506035:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784045125.506143:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.506152:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 000000006e2ef467/0xdb5b5ff6a2d2c9fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045125.506159:0:5785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784045125.506163:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045125.506169:0:5785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8aa90538d800 10000000:01000000:0.0:1784045125.506173:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784045125.506176:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784045125.506178:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784045125.506195:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.506210:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.506218:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045125.506230:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689600:0@lo:101: 00000100:00100000:0.0:1784045125.506271:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045125.506295:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015c3e516 going to sleep for 11 seconds 00000100:00100000:2.0:1784045125.506348:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689600 00000100:00100000:2.0:1784045125.506353:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689600 00000100:00100000:2.0:1784045125.506385:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045125.506392:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027e36bdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+7:5785:x1870706829689600:12345-0@lo:101: 00010000:00010000:2.0:1784045125.506399:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045125.506407:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0f1854a/0xdb5b5ff6a2d2ca12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ca0b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.506420:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0f1854a/0xdb5b5ff6a2d2ca12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.506427:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0f1854a/0xdb5b5ff6a2d2ca12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045125.506434:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0f1854a, rc 0) 00000100:00100000:2.0:1784045125.506469:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027e36bdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+8:5785:x1870706829689600:12345-0@lo:101: Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045125.506475:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045125.506659:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689600:0@lo:101: 00010000:00010000:0.0:1784045125.506669:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045125.506676:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045125.506720:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689728:0@lo:501: 00000100:00100000:0.0:1784045125.506745:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045125.506765:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015c3e516 going to sleep for 11 seconds 00000100:00100000:3.0:1784045125.506926:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689728 00000100:00100000:3.0:1784045125.506931:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689728 00000100:00100000:3.0:1784045125.506952:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045125.506958:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c659b4fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+8:5785:x1870706829689728:12345-0@lo:501: 00000100:00100000:3.0:1784045125.507221:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c659b4fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5785:x1870706829689728:12345-0@lo:501: Request processed in 262us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045125.507236:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045125.507390:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689728:0@lo:501: 00000100:00100000:0.0:1784045125.507419:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689856:0@lo:503: 00000100:00100000:0.0:1784045125.507457:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045125.507484:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015c3e516 going to sleep for 11 seconds 00000100:00100000:2.0:1784045125.507614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689856 00000100:00100000:2.0:1784045125.507619:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689856 00000100:00100000:2.0:1784045125.507653:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045125.507659:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055c8da37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5785:x1870706829689856:12345-0@lo:503: 00000100:00100000:2.0:1784045125.507805:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055c8da37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5785:x1870706829689856:12345-0@lo:503: Request processed in 146us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045125.507812:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045125.507953:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829689856:0@lo:503: 00000100:00100000:3.0:1784045125.508378:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df05241a pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5827:1870706829689984:0@lo:502: 00000100:00100000:3.0:1784045125.508414:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045125.508445:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c8935995 going to sleep for 11 seconds 00000100:00100000:2.0:1784045125.508494:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829689984 00000100:00100000:2.0:1784045125.508568:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829689984 00000100:00100000:2.0:1784045125.508602:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045125.508608:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079d47e75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5827:x1870706829689984:12345-0@lo:502: 00000100:00100000:2.0:1784045125.508771:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079d47e75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5827:x1870706829689984:12345-0@lo:502: Request processed in 162us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045125.508778:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045125.508869:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df05241a pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5827:1870706829689984:0@lo:502: 00000020:01000000:0.0:1784045125.508897:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045125.508907:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045125.508909:0:5827:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784045125.508914:0:5827:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784045125.508917:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045125.508932:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000012a480bb) 00000020:00000080:0.0:1784045125.508953:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784045125.508958:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784045125.509031:0:5827:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784045125.509038:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2ca20 00000020:00000080:0.0:1784045125.509375:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784045125.509379:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045125.509383:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045125.509385:0:5827:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784045125.509387:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045125.509391:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045125.509392:0:5827:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784045125.509395:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045125.509401:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006e4a36f5) 00000020:00000080:0.0:1784045125.509411:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784045125.509414:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784045125.509416:0:5827:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784045125.509419:0:5827:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784045125.509424:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784045125.509461:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009354089b from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784045125.509471:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ba2adf98) 00000020:00000080:0.0:1784045125.509478:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784045125.509680:0:5827:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784045125.509685:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2ca35 00000020:00000080:0.0:1784045125.509769:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784045125.509774:0:5827:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784045125.509779:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb5b5ff6a2d2ca3c 00080000:01000000:0.0:1784045125.509783:0:5827:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784045125.509793:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2ca43 00080000:10000000:0.0:1784045125.510363:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1784045125.510765:0:5827:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1784045125.518038:0:5827:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784045125.626157:0:5827:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1784045125.627096:0:5827:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1784045125.637022:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784045125.637393:0:5827:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784045125.668319:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000a32b56b) 00000020:00000080:2.0:1784045125.668344:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784045125.668409:0:5827:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784045125.668415:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2ca51 00000020:00000080:3.0:1784045125.678237:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1784045125.680947:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784045125.723656:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045125.777026:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784045125.845415:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:2.0:1784045125.857172:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784045125.887691:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784045126.013610:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1784045126.080293:0:5827:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb5b5ff6a2d2ca58 00000020:00000080:3.0:1784045126.080644:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784045126.080657:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045126.080663:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045126.080665:0:5827:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784045126.080668:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045126.080672:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045126.080674:0:5827:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784045126.080677:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784045126.080678:0:5827:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784045126.080681:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045126.080683:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045126.080684:0:5827:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784045126.080686:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045126.080690:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045126.080691:0:5827:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784045126.080696:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784045126.080727:0:5827:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784045126.080787:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c225a6be pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5827:1870706829690112:0@lo:502: 00000100:00100000:3.0:1784045126.080913:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045126.080973:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set 00000000165380cb going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.081065:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690112 00000100:00100000:0.0:1784045126.081073:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690112 00000100:00100000:0.0:1784045126.081123:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045126.081135:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceccb187 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5827:x1870706829690112:12345-0@lo:502: 00000100:00100000:0.0:1784045126.081562:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceccb187 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5827:x1870706829690112:12345-0@lo:502: Request processed in 429us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.081572:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045126.081886:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c225a6be pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5827:1870706829690112:0@lo:502: 00000020:01000000:3.0:1784045126.081927:0:5827:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045126.081934:0:5827:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045126.081936:0:5827:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1784045126.081940:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1784045126.082250:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1784045126.082274:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784045126.082330:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.082344:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000b42895ad/0xdb5b5ff6a2d2ca0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045126.082352:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa90538d800 from 1 10000000:01000000:0.0:1784045126.082355:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784045126.082387:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.082394:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.082404:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045126.082434:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690240:0@lo:101: 00000100:00100000:0.0:1784045126.082481:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045126.082518:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c8935995 going to sleep for 11 seconds 00000100:00100000:3.0:1784045126.082642:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690240 00000100:00100000:3.0:1784045126.082648:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690240 00000100:00100000:3.0:1784045126.082688:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045126.082696:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d4de2ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:5785:x1870706829690240:12345-0@lo:101: 00010000:00010000:3.0:1784045126.082708:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045126.082721:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ca5f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045126.082745:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045126.082756:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045126.082766:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0b7ec71, rc 0) 00000100:00100000:3.0:1784045126.082812:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d4de2ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:5785:x1870706829690240:12345-0@lo:101: Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045126.082819:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045126.082981:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5344a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690240:0@lo:101: 00010000:00010000:1.0:1784045126.082995:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.083004:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045126.083564:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b241bf2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690368:0@lo:256: 00000100:00100000:1.0:1784045126.083615:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045126.083654:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074090d5a going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.083804:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690368 00000100:00100000:0.0:1784045126.083809:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690368 00000100:00100000:0.0:1784045126.083876:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045126.083884:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0615b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:5785:x1870706829690368:12345-0@lo:256: 20000000:01000000:0.0:1784045126.083900:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784045126.083906:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1784045126.083987:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0615b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:5785:x1870706829690368:12345-0@lo:256: Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.083994:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784045126.084219:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b241bf2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690368:0@lo:256: 10000000:01000000:1.0:1784045126.084801:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784045126.085137:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.085150:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045126.085173:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90538d800 from 1 10000000:01000000:1.0:1784045126.085176:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045126.085209:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.085218:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.085226:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045126.085254:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b241bf2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690496:0@lo:101: 00000100:00100000:1.0:1784045126.085296:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045126.085321:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074090d5a going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.085388:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690496 00000100:00100000:0.0:1784045126.085395:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690496 00000100:00100000:0.0:1784045126.085441:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045126.085448:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063fe472e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:5785:x1870706829690496:12345-0@lo:101: 00010000:00010000:0.0:1784045126.085459:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045126.085473:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ca6d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.085500:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.085509:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.085518:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000016cdf635, rc 0) 00000100:00100000:0.0:1784045126.085568:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063fe472e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829690496:12345-0@lo:101: Request processed in 120us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.085574:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045126.085658:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b241bf2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690496:0@lo:101: 00010000:00010000:3.0:1784045126.085670:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045126.085679:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045126.085740:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c225a6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690624:0@lo:501: 00000100:00100000:3.0:1784045126.085767:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045126.085931:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcdb4533 going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.086011:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690624 00000100:00100000:0.0:1784045126.086016:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690624 00000100:00100000:0.0:1784045126.086138:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045126.086145:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071c095e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829690624:12345-0@lo:501: 00000100:00100000:0.0:1784045126.086753:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071c095e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829690624:12345-0@lo:501: Request processed in 608us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.086761:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045126.090677:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c225a6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690624:0@lo:501: 00000100:00100000:3.0:1784045126.093221:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c225a6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690752:0@lo:503: 00000100:00100000:3.0:1784045126.093496:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045126.093600:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d59102e going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.100346:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690752 00000100:00100000:0.0:1784045126.100367:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690752 00000100:00100000:0.0:1784045126.100453:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045126.100463:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3b7ef1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829690752:12345-0@lo:503: 00000040:00080000:0.0:1784045126.100670:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784045126.100961:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3b7ef1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829690752:12345-0@lo:503: Request processed in 498us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.100970:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045126.101181:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c225a6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690752:0@lo:503: 00000040:00080000:1.0:1784045126.102437:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784045126.102689:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784045126.102722:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045126.102746:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.102772:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045126.102818:0:5785:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784045126.102822:0:5785:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa90538d800 10000000:01000000:2.0:1784045126.102824:0:5785:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa90538d800 10000000:01000000:2.0:1784045126.102855:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784045126.102862:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa90538d800 from 1 10000000:01000000:2.0:1784045126.102864:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045126.102909:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.102916:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.102927:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045126.102952:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690880:0@lo:101: 00000100:00100000:2.0:1784045126.103019:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045126.103083:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b7f7129 going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.103465:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829690880 00000100:00100000:0.0:1784045126.103480:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829690880 00000100:00100000:0.0:1784045126.103542:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045126.103551:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008870411f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829690880:12345-0@lo:101: 00010000:00010000:0.0:1784045126.103565:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045126.103578:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002be6e7a7/0xdb5b5ff6a2d2ca82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ca7b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.103605:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002be6e7a7/0xdb5b5ff6a2d2ca82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.103628:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002be6e7a7/0xdb5b5ff6a2d2ca82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.103638:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002be6e7a7, rc 0) 00000100:00100000:0.0:1784045126.103692:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008870411f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5785:x1870706829690880:12345-0@lo:101: Request processed in 141us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.103699:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784045126.103740:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829690880:0@lo:101: 00010000:00010000:2.0:1784045126.103756:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.103765:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045126.103853:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829691008:0@lo:501: 00000100:00100000:2.0:1784045126.103883:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045126.103905:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b7f7129 going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.105014:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691008 00000100:00100000:0.0:1784045126.105038:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691008 00000100:00100000:0.0:1784045126.105094:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045126.105102:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e7a75d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5785:x1870706829691008:12345-0@lo:501: 00000100:00100000:0.0:1784045126.105423:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e7a75d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5785:x1870706829691008:12345-0@lo:501: Request processed in 321us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.105431:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045126.105739:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829691008:0@lo:501: 00000100:00100000:2.0:1784045126.105788:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829691136:0@lo:503: 00000100:00100000:2.0:1784045126.105869:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045126.105908:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 000000007b7f7129 going to sleep for 11 seconds 00000100:00100000:0.0:1784045126.106089:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691136 00000100:00100000:0.0:1784045126.106095:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691136 00000100:00100000:0.0:1784045126.106129:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045126.106135:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5190f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5785:x1870706829691136:12345-0@lo:503: 00000100:00100000:0.0:1784045126.106460:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5190f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5785:x1870706829691136:12345-0@lo:503: Request processed in 325us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045126.106467:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045126.106592:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829691136:0@lo:503: 00000100:00100000:2.0:1784045126.118674:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5832:1870706829691264:0@lo:502: 00000100:00100000:2.0:1784045126.118778:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045126.121021:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 0000000064c73b1c going to sleep for 11 seconds 00000100:00100000:3.0:1784045126.122994:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691264 00000100:00100000:3.0:1784045126.123010:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691264 00000100:00100000:3.0:1784045126.123092:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045126.123102:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a7311be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5832:x1870706829691264:12345-0@lo:502: 00000100:00100000:3.0:1784045126.123475:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a7311be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5832:x1870706829691264:12345-0@lo:502: Request processed in 373us (4696us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045126.123484:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045126.126665:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005393e2b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5832:1870706829691264:0@lo:502: 00000020:01000004:3.0:1784045126.126767:0:5832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784045126.126784:0:5832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dbc7411c) 00000020:00000080:3.0:1784045126.126810:0:5832:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1784045126.129081:0:5832:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009354089b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784045126.129096:0:5832:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009354089b from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784045126.129099:0:5832:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009354089b 4 00010000:00080000:3.0:1784045126.129143:0:5832:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003a174f98@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1784045126.130886:0:5832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1784045126.131032:0:5832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784045126.131072:0:5832:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045126.131086:0:5832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb5b5ff6a2d2ca90 00000100:00080000:3.0:1784045126.131098:0:5832:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045126.131110:0:5832:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a174f98 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1784045126.131160:0:5832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004c7a295a x1870706829691392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045126.131191:0:5832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784045126.131422:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c7a295a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829691392:0@lo:38: 00000100:00100000:1.0:1784045126.131520:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045126.136391:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691392 00000100:00100000:3.0:1784045126.136415:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691392 00000100:00100000:3.0:1784045126.138415:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045126.138428:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a55167e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1870706829691392:12345-0@lo:38: 00000100:00100000:3.0:1784045126.138567:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a55167e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1870706829691392:12345-0@lo:38: Request processed in 137us (7046us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784045126.138575:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045126.138657:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045126.138667:0:3317:0:(import.c:65:import_set_state_nolock()) 000000003a174f98 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045126.138671:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784045126.138675:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c7a295a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829691392:0@lo:38: 00000100:00100000:2.0:1784045126.146344:0:5832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001028b3e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5832:1870706829691520:0@lo:502: 00000100:00100000:2.0:1784045126.146443:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045126.146527:0:5832:0:(client.c:2702:ptlrpc_set_wait()) set 000000004cd77984 going to sleep for 11 seconds 00000100:00100000:1.0:1784045126.150332:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691520 00000100:00100000:1.0:1784045126.150355:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691520 00000100:00100000:1.0:1784045126.150514:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784045126.150524:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000550b620a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5832:x1870706829691520:12345-0@lo:502: 00000100:00100000:1.0:1784045126.150864:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000550b620a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5832:x1870706829691520:12345-0@lo:502: Request processed in 341us (4421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045126.150873:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045126.151012:0:5832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001028b3e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5832:1870706829691520:0@lo:502: 00000040:00080000:2.0:1784045126.151063:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1784045126.152427:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784045126.152473:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045126.152496:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.152511:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 000000007a9306b7/0xdb5b5ff6a2d2ca7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784045126.152563:0:5785:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784045126.152566:0:5785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045126.152567:0:5785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045126.152568:0:5785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045126.152569:0:5785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045126.152570:0:5785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045126.152571:0:5785:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045126.152573:0:5785:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045126.152575:0:5785:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045126.152576:0:5785:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045126.152578:0:5785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045126.152579:0:5785:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045126.152583:0:5785:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784045126.152585:0:5785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045126.152587:0:5785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045126.152588:0:5785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045126.152589:0:5785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045126.152590:0:5785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045126.152591:0:5785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045126.152592:0:5785:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045126.152593:0:5785:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045126.152594:0:5785:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045126.152595:0:5785:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045126.152596:0:5785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045126.152597:0:5785:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045126.152627:0:5785:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784045126.152651:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005b8bc432 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829691648:0@lo:253: 00000100:00100000:0.0:1784045126.152716:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045126.159656:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ae6c64ec going to sleep for 11 seconds 00000100:00100000:3.0:1784045126.160377:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691648 00000100:00100000:3.0:1784045126.160391:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691648 00000100:00100000:3.0:1784045126.160460:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784045126.160469:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ad6e125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5785:x1870706829691648:12345-0@lo:253: 20000000:01000000:3.0:1784045126.160678:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784045126.160697:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784045126.204180:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784045126.204206:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784045126.204376:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784045126.204381:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784045126.204406:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.204435:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.204445:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.204570:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.204589:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 12 pid: 5799 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045126.204606:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a8339c9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1870706829691776:0@lo:104: 00000100:00100000:1.0:1784045126.204675:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045126.204778:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 000000001f3b8d19 going to sleep for 11 seconds 00000100:00100000:1.0:1784045126.208194:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691776 00000100:00100000:1.0:1784045126.208216:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691776 00000100:00100000:1.0:1784045126.208332:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045126.208342:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003137f51d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5820:x1870706829691776:12345-0@lo:104: 00010000:00010000:1.0:1784045126.208365:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045126.208562:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045126.208569:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003137f51d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5820:x1870706829691776:12345-0@lo:104: Request processed in 228us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045126.208577:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784045126.208631:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045126.208638:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.208646:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2e1c047 already unused, calling callback (00000000d86aa52f) 10000000:00010000:2.0:1784045126.208649:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.208670:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045126.208677:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045126.208682:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045126.208733:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.208740:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045126.208766:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.208772:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: 00000000b2e1c047/0xdb5b5ff6a2d2ca5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca66 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.208792:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045126.208793:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045126.208795:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045126.208827:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a8339c9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1870706829691776:0@lo:104: 00000100:00100000:0.0:1784045126.208851:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045126.208871:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001028b3e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829691904:0@lo:103: 00010000:00010000:2.0:1784045126.208893:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045126.208916:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045126.208943:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829691904 00000100:00100000:2.0:1784045126.208947:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829691904 00010000:00010000:2.0:1784045126.208965:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 13 pid: 5799 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045126.209004:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045126.209018:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bf1b820 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:3318:x1870706829691904:12345-0@lo:103: 00010000:00010000:2.0:1784045126.209040:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045126.209046:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 13 pid: 5799 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209055:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 13 pid: 5799 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209069:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e0b7ec71/0xdb5b5ff6a2d2ca66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca5f expref: 13 pid: 5799 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209083:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209092:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784045126.209108:0:5789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004726918s 00010000:00010000:2.0:1784045126.209113:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209120:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209126:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209132:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209137:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de36b1a3 already unused, calling callback (00000000af526bde) 00010000:00010000:2.0:1784045126.209147:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209154:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209174:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045126.209184:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045126.209215:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bf1b820 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3318:x1870706829691904:12345-0@lo:103: Request processed in 198us (298us total) trans 0 rc 0/0 00010000:00010000:0.0:1784045126.209217:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045126.209221:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784045126.209224:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045126.209229:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de36b1a3/0xdb5b5ff6a2d2ca97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045126.209288:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001028b3e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829691904:0@lo:103: 00000100:00100000:3.0:1784045126.214394:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ad6e125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5785:x1870706829691648:12345-0@lo:253: Request processed in 53915us (61668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045126.214413:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784045126.214695:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005b8bc432 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5785:1870706829691648:0@lo:253: 10000000:01000000:0.0:1784045126.214713:0:5785:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784045126.214718:0:5785:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045126.214720:0:5785:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045126.214722:0:5785:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045126.214723:0:5785:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045126.214724:0:5785:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045126.214725:0:5785:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045126.214726:0:5785:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045126.214728:0:5785:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045126.214729:0:5785:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045126.214731:0:5785:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045126.214733:0:5785:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045126.214734:0:5785:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784045126.214940:0:5785:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784045126.226275:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045126.226968:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045126.227280:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045126.227576:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045126.228098:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045126.228315:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045126.230263:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045126.230451:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045126.230744:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045126.231131:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045126.231340:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045126.231636:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1784045126.281490:0:5785:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1784045126.312648:0:5785:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1784045126.312980:0:5838:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1784045126.315217:0:5837:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784045126.315225:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1784045126.316430:0:5785:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784045126.316654:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784045126.317100:0:5785:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784045126.317107:0:5785:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784045126.317232:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045126.318645:0:5785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784045126.319353:0:5785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784045126.319392:0:5785:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784045126.319648:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784045126.319874:0:5785:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1784045126.322609:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1784045126.322761:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1784045126.322995:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1784045126.323217:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1784045126.323363:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1784045126.323523:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1784045126.323654:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1784045126.323798:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1784045126.324800:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1784045126.324986:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1784045126.325169:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1784045126.325326:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1784045126.325452:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1784045126.325602:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1784045126.325744:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1784045126.325932:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1784045126.326618:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1784045126.326775:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1784045126.326996:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1784045126.327211:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1784045126.327366:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1784045126.327515:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1784045126.327652:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1784045126.327810:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1784045126.332534:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1784045126.332692:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1784045126.332886:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1784045126.333027:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1784045126.333179:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1784045126.333342:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1784045126.333494:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1784045126.333660:0:5785:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1784045126.333917:0:5785:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1784045126.360065:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1784045126.396583:0:5785:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784045126.396623:0:5785:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb518c1dc7988 00100000:10000000:2.0:1784045126.396631:0:5785:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784045126.400245:0:5785:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784045126.400265:0:5785:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784045126.400280:0:5785:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784045126.400309:0:5785:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1784045126.449723:0:5838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784045126.449806:0:5838:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784045126.449811:0:5838:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1784045126.883188:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045127.905858:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045128.930500:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045129.953189:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045130.977045:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784045131.171086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784045131.171099:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784045131.171102:0:36:0:(import.c:65:import_set_state_nolock()) 000000003a174f98 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045131.171117:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003a174f98 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1784045131.171163:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001b476951 x1870706829692160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045131.171216:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001b476951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829692160:0@lo:38: 00000100:00100000:3.0:1784045131.171326:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045131.171546:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045131.171556:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e989808d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829692032:0@lo:400: 00000100:00100000:2.0:1784045131.171592:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045131.171661:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692032 00000100:00100000:3.0:1784045131.171671:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692032 00000100:00100000:3.0:1784045131.171730:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045131.171739:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d525d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3321:x1870706829692032:12345-0@lo:400: 00000100:00100000:3.0:1784045131.171791:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d525d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3321:x1870706829692032:12345-0@lo:400: Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045131.171800:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045131.171918:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e989808d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829692032:0@lo:400: 00000100:00100000:0.0:1784045131.172015:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692160 00000100:00100000:0.0:1784045131.172020:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692160 00000100:00100000:0.0:1784045131.172053:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045131.172058:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d1dce73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1870706829692160:12345-0@lo:38: 00010000:00080000:0.0:1784045131.172080:0:5806:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1784045131.172118:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb5b5ff6a2d2ca9e 00000004:00100000:0.0:1784045131.172178:0:5806:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045131.172387:0:5806:0:(import.c:65:import_set_state_nolock()) 00000000169a2b9f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045131.172514:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d1dce73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1870706829692160:12345-0@lo:38: Request processed in 455us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045131.172522:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784045131.177012:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001b476951 x1870706829692160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784045131.177040:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784045131.177048:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784045131.177055:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784045131.177058:0:3317:0:(import.c:65:import_set_state_nolock()) 000000003a174f98 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784045131.177065:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001b476951 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829692160:0@lo:38: 00000001:02000400:0.0:1784045131.306776:0:6081:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784045132.007057:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045133.025261:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045134.054166:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784045134.755029:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784045134.755036:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa90538d800 from 3 10000000:01000000:0.0:1784045134.755041:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784045134.755082:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045134.755122:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045134.755133:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045134.755157:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005b8bc432 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829692288:0@lo:101: 00000100:00100000:0.0:1784045134.755222:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045134.755869:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcd7d87b going to sleep for 11 seconds 00000100:00100000:3.0:1784045134.764142:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692288 00000100:00100000:3.0:1784045134.764158:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692288 00000100:00100000:3.0:1784045134.764221:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045134.764230:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a01611b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5801:x1870706829692288:12345-0@lo:101: 00010000:00010000:3.0:1784045134.765040:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045134.765061:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000284e2f/0xdb5b5ff6a2d2caac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2caa5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045134.765105:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000284e2f/0xdb5b5ff6a2d2caac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045134.765117:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000284e2f/0xdb5b5ff6a2d2caac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045134.765125:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000284e2f, rc 0) 00000100:00100000:3.0:1784045134.765204:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a01611b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829692288:12345-0@lo:101: Request processed in 975us (9982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045134.765211:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045134.766110:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005b8bc432 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829692288:0@lo:101: 00010000:00010000:3.0:1784045134.766135:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045134.766147:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045134.766226:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000694fac77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829692416:0@lo:256: 00000100:00100000:3.0:1784045134.767101:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045134.767145:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005049dcf going to sleep for 11 seconds 00000100:00100000:3.0:1784045134.767171:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692416 00000100:00100000:3.0:1784045134.767178:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692416 00000100:00100000:3.0:1784045134.767221:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045134.767230:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008efd2340 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829692416:12345-0@lo:256: 20000000:01000000:3.0:1784045134.769858:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784045134.770308:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784045134.770314:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784045134.771123:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008efd2340 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829692416:12345-0@lo:256: Request processed in 3890us (4029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045134.771136:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045134.771797:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000694fac77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829692416:0@lo:256: 10000000:01000000:2.0:1784045134.772657:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045134.772672:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045134.772685:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000e772f963/0xdb5b5ff6a2d2caa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.073121:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784045135.989132:0:6283:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7b4a2b90 20000000:00000080:2.0:1784045135.989149:0:6283:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa93b58c800 uarg=0000000000000000 20000000:01000000:2.0:1784045135.989184:0:6283:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784045135.989191:0:6283:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784045135.989196:0:6283:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784045135.989445:0:6283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1784045135.989459:0:6283:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1784045135.993810:0:6283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045135.994181:0:6283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784045135.994240:0:6283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1784045135.994303:0:6283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1784045135.994324:0:6283:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784045135.994346:0:6283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045135.994367:0:6283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045135.994375:0:6283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045135.994417:0:6283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045135.994434:0:6283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 11 pid: 5797 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045135.994449:0:6283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026adfda6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6283:1870706829692544:0@lo:104: 00000100:00100000:2.0:1784045135.994512:0:6283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045135.994584:0:6283:0:(client.c:2702:ptlrpc_set_wait()) set 00000000476ead97 going to sleep for 11 seconds 00000100:00100000:1.0:1784045135.995119:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692544 00000100:00100000:1.0:1784045135.995128:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692544 00000100:00100000:1.0:1784045135.995190:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045135.995199:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059ae1a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:6283:x1870706829692544:12345-0@lo:104: 00010000:00010000:1.0:1784045135.995213:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.995278:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045135.995283:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059ae1a72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:6283:x1870706829692544:12345-0@lo:104: Request processed in 86us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045135.995297:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784045135.995322:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045135.995327:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.995335:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fccd18d8 already unused, calling callback (00000000d86aa52f) 10000000:00010000:1.0:1784045135.995338:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.995346:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045135.995360:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045135.995366:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045135.995396:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.995403:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045135.995420:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.995426:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: 00000000fccd18d8/0xdb5b5ff6a2d2ca6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.995442:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045135.995444:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045135.995446:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045135.995465:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005468a116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829692672:0@lo:103: 00000100:00100000:1.0:1784045135.995505:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045135.995629:0:6283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026adfda6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6283:1870706829692544:0@lo:104: 00010000:00010000:3.0:1784045135.995650:0:6283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045135.996121:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692672 00000100:00100000:1.0:1784045135.996128:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692672 00010000:00010000:1.0:1784045135.996154:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 12 pid: 5797 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045135.996187:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045135.996194:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7eb8b0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3321:x1870706829692672:12345-0@lo:103: 00010000:00010000:1.0:1784045135.996207:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045135.996212:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 12 pid: 5797 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996224:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 12 pid: 5797 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996238:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000016cdf635/0xdb5b5ff6a2d2ca74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca6d expref: 12 pid: 5797 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996253:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996259:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996273:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996280:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996286:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996622:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996630:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076ca2d5a already unused, calling callback (00000000af526bde) 00010000:00010000:1.0:1784045135.996634:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045135.996641:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045136.014052:0:6283:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045136.014084:0:6283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045136.018679:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045136.018703:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076ca2d5a/0xdb5b5ff6a2d2cab3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045136.018725:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045136.018856:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7eb8b0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3321:x1870706829692672:12345-0@lo:103: Request processed in 22635us (23323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045136.018876:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045136.019110:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005468a116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829692672:0@lo:103: 00010000:00010000:3.0:1784045136.099320:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045136.289371:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045136.289397:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074905305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829692800:0@lo:400: 00000100:00100000:2.0:1784045136.289468:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045136.289581:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692800 00000100:00100000:3.0:1784045136.289590:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692800 00000100:00100000:3.0:1784045136.289657:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045136.289665:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dc0e5e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829692800:12345-0@lo:400: 00000100:00100000:3.0:1784045136.289731:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dc0e5e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829692800:12345-0@lo:400: Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045136.289738:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784045136.289777:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000074905305 x1870706829692800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045136.289792:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074905305 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829692800:0@lo:400: 00010000:00010000:2.0:1784045137.121106:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045138.150729:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045139.181732:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045140.193719:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045141.221399:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045141.413674:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829692928:0@lo:400: 00000100:00100000:2.0:1784045141.413747:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045141.413808:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8856af3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829693056:0@lo:400: 00000100:00100000:2.0:1784045141.413850:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045141.413959:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829692928 00000100:00100000:2.0:1784045141.413967:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829692928 00000100:00100000:2.0:1784045141.414036:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045141.414043:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da7f43c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3319:x1870706829692928:12345-0@lo:400: 00000100:00100000:2.0:1784045141.414097:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da7f43c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3319:x1870706829692928:12345-0@lo:400: Request processed in 56us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045141.417501:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693056 00000100:00100000:1.0:1784045141.417523:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693056 00000100:00100000:1.0:1784045141.417878:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045141.417887:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cec3ae1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829693056:12345-0@lo:400: 00000100:00100000:1.0:1784045141.417991:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cec3ae1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829693056:12345-0@lo:400: Request processed in 105us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045141.417998:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045141.418054:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d8856af3 x1870706829693056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045141.418069:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8856af3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829693056:0@lo:400: 00000100:00100000:2.0:1784045141.418268:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045141.418317:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829692928:0@lo:400: 10000000:01000000:2.0:1784045141.418334:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045141.418337:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90538d800 from 1 10000000:01000000:2.0:1784045141.418340:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045141.418370:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 0000000086b97081/0xdb5b5ff6a2d2caba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045141.418380:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 0000000086b97081/0xdb5b5ff6a2d2caba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045141.418390:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 0000000086b97081/0xdb5b5ff6a2d2caba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045141.418408:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829693184:0@lo:101: 00000100:00100000:2.0:1784045141.418439:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045141.418481:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e3d7c76b going to sleep for 11 seconds 00000100:00100000:1.0:1784045141.418590:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693184 00000100:00100000:1.0:1784045141.418595:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693184 00000100:00100000:1.0:1784045141.418708:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045141.418715:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9e4385f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:5801:x1870706829693184:12345-0@lo:101: 00010000:00010000:1.0:1784045141.418726:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045141.418740:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cbbe7b79/0xdb5b5ff6a2d2cac1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2caba expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045141.418762:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cbbe7b79/0xdb5b5ff6a2d2cac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045141.418772:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cbbe7b79/0xdb5b5ff6a2d2cac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045141.418781:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cbbe7b79, rc 0) 00000100:00100000:1.0:1784045141.418812:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9e4385f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829693184:12345-0@lo:101: Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045141.418818:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045141.419145:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829693184:0@lo:101: 00010000:00010000:2.0:1784045141.419159:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 0000000086b97081/0xdb5b5ff6a2d2caba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045141.419169:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 0000000086b97081/0xdb5b5ff6a2d2caba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045141.419221:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829693312:0@lo:501: 00000100:00100000:2.0:1784045141.419257:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045141.419285:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e3d7c76b going to sleep for 11 seconds 00000100:00100000:1.0:1784045141.419320:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693312 00000100:00100000:1.0:1784045141.419324:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693312 00000100:00100000:1.0:1784045141.419381:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045141.419387:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fec7225c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829693312:12345-0@lo:501: 00000100:00100000:1.0:1784045141.419823:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fec7225c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829693312:12345-0@lo:501: Request processed in 436us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045141.420069:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045141.420202:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829693312:0@lo:501: 00000100:00100000:2.0:1784045141.420241:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829693440:0@lo:503: 00000100:00100000:2.0:1784045141.420279:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045141.420313:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e3d7c76b going to sleep for 11 seconds 00000100:00100000:0.0:1784045141.420367:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693440 00000100:00100000:0.0:1784045141.420372:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693440 00000100:00100000:0.0:1784045141.420406:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045141.420413:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4b6a389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829693440:12345-0@lo:503: 00000100:00100000:0.0:1784045141.421211:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4b6a389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829693440:12345-0@lo:503: Request processed in 795us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045141.421220:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045141.421401:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ae2e3208 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829693440:0@lo:503: 00000100:00100000:1.0:1784045141.429142:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b8d3c2b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6586:1870706829693568:0@lo:502: 00000100:00100000:1.0:1784045141.429234:0:6586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045141.429281:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set 000000007ccee9a3 going to sleep for 11 seconds 00000100:00100000:2.0:1784045141.431067:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693568 00000100:00100000:2.0:1784045141.431081:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693568 00000100:00100000:2.0:1784045141.431149:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045141.431159:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083f0f485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6586:x1870706829693568:12345-0@lo:502: 00000100:00100000:2.0:1784045141.431491:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083f0f485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6586:x1870706829693568:12345-0@lo:502: Request processed in 333us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045141.431499:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784045141.431729:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b8d3c2b1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6586:1870706829693568:0@lo:502: 00000020:01000000:1.0:1784045141.431766:0:6586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045141.431776:0:6586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045141.431778:0:6586:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784045141.431784:0:6586:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa90538d800 00000020:00000080:1.0:1784045141.431787:0:6586:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784045141.432178:0:6586:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6586:1870706829693696:0@lo:502: 00000100:00100000:1.0:1784045141.432237:0:6586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045141.432280:0:6586:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045141.432290:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693696 00000100:00100000:3.0:1784045141.432295:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693696 00000100:00100000:3.0:1784045141.432334:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045141.432341:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6586:x1870706829693696:12345-0@lo:502: 00000100:00100000:3.0:1784045141.432481:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6586:x1870706829693696:12345-0@lo:502: Request processed in 140us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045141.432488:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784045141.436536:0:6586:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6586:1870706829693696:0@lo:502: 00000020:01000000:2.0:1784045141.436601:0:6586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045141.436612:0:6586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045141.436615:0:6586:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784045141.436620:0:6586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1784045141.436740:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784045141.436760:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045141.436770:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045141.436781:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784045141.979246:0:6595:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784045141.979249:0:6595:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1784045141.979387:0:6595:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8aa907eaf000 00000020:01000004:3.0:1784045141.979405:0:6595:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784045141.979416:0:6595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784045141.979438:0:6595:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8aa907fe8000) 00000020:00000080:3.0:1784045141.979454:0:6595:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784045142.008418:0:6595:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1784045142.009178:0:6595:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1784045142.035530:0:6595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784045142.042378:0:6595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784045142.042415:0:6595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784045142.042475:0:6595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784045142.042508:0:6595:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784045142.043191:0:6595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784045142.043203:0:6595:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045142.043220:0:6595:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb5b5ff6a2d2cacf 00000020:01000004:2.0:1784045142.043229:0:6595:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784045142.043249:0:6595:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784045142.043253:0:6595:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784045142.043259:0:6595:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784045142.043264:0:6595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784045142.043275:0:6595:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8aa93b590000) 00000020:00000080:2.0:1784045142.043284:0:6595:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1784045142.046346:0:6595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045142.046534:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784045142.046540:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784045142.052327:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784045142.052342:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784045142.052631:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784045142.052638:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1784045142.054298:0:6595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045142.054480:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1784045142.054487:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784045142.056393:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784045142.056405:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784045142.089270:0:6595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045142.089551:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784045142.089559:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784045142.096464:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045142.096481:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784045142.101021:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784045142.101040:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784045142.104055:0:6595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045142.104299:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784045142.104307:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1784045142.105375:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1784045142.105384:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784045142.196614:0:6595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045142.196890:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784045142.196897:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784045142.202328:0:6595:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784045142.202349:0:6595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784045142.202883:0:6595:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784045142.202907:0:6595:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784045142.202914:0:6595:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1784045142.240954:0:6595:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784045142.240998:0:6595:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1784045142.241002:0:6595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784045142.241004:0:6595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784045142.241005:0:6595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045142.241006:0:6595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045142.241007:0:6595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045142.241009:0:6595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045142.241010:0:6595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045142.241012:0:6595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045142.241013:0:6595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045142.241015:0:6595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045142.241019:0:6595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784045142.241024:0:6595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1784045142.241026:0:6595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784045142.241028:0:6595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784045142.241029:0:6595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045142.241030:0:6595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045142.241031:0:6595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045142.241032:0:6595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045142.241033:0:6595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045142.241034:0:6595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045142.241035:0:6595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045142.241035:0:6595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045142.241036:0:6595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784045142.241071:0:6595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784045142.241092:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829693824:0@lo:253: 00000100:00100000:2.0:1784045142.241163:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.241399:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693824 00000100:00100000:0.0:1784045142.241407:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693824 00000100:00100000:0.0:1784045142.241461:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045142.241470:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829693824:12345-0@lo:253: 20000000:01000000:0.0:1784045142.241503:0:5797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784045142.241507:0:5797:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1784045142.241511:0:5797:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1784045142.241514:0:5797:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1784045142.242426:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045142.242657:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1784045142.242671:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1784045142.242711:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1784045142.242719:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1784045142.242752:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1784045142.242818:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1784045142.243254:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1784045142.243276:0:5797:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:0.0:1784045142.243278:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:0.0:1784045142.243314:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1784045142.243322:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784045142.243391:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1784045142.243401:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:0.0:1784045142.243436:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1784045142.243445:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784045142.243478:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1784045142.243527:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1784045142.244185:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1784045142.244199:0:5797:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:0.0:1784045142.244201:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:0.0:1784045142.244235:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1784045142.244242:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784045142.244273:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1784045142.244280:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:0.0:1784045142.244335:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1784045142.244344:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784045142.244376:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1784045142.244412:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1784045142.244428:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784045142.244431:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784045142.244434:0:5797:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784045142.244445:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784045142.244448:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784045142.244477:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784045142.244479:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000100:00100000:2.0:1784045142.244678:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523000 going to sleep for 11 seconds 00010000:00010000:1.0:1784045142.245139:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1784045142.247159:0:6610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1784045142.247245:0:6610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1784045142.247305:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1784045142.247728:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1784045142.247770:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1784045142.247885:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1784045142.247899:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784045142.247902:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784045142.257688:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1784045142.258137:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1784045142.258179:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1784045142.258239:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1784045142.258251:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784045142.258254:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784045142.262280:0:6612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1784045142.262373:0:6612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1784045142.262428:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784045142.262805:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1784045142.262881:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1784045142.262920:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1784045142.262936:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1784045142.262939:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1784045142.262947:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784045142.262978:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.262996:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.263004:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.263011:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.263030:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.263070:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.263084:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 12 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045142.263099:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1870706829693952:0@lo:104: 00000100:00100000:0.0:1784045142.263162:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045142.263318:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829693952 00000100:00100000:1.0:1784045142.263325:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829693952 00000100:00100000:1.0:1784045142.263366:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045142.263375:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5797:x1870706829693952:12345-0@lo:104: 00010000:00010000:1.0:1784045142.263395:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263442:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045142.263448:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5797:x1870706829693952:12345-0@lo:104: Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045142.263454:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784045142.263571:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.263580:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 12 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045142.263589:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1870706829694080:0@lo:104: 00000100:00100000:0.0:1784045142.263611:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045142.263662:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694080 00000100:00100000:1.0:1784045142.263667:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694080 00000100:00100000:1.0:1784045142.263683:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045142.263689:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5797:x1870706829694080:12345-0@lo:104: 00010000:00010000:1.0:1784045142.263698:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263731:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045142.263736:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5797:x1870706829694080:12345-0@lo:104: Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045142.263742:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1784045142.263757:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045142.263763:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263770:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784045142.263774:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263782:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045142.263810:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045142.263816:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045142.263862:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263868:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045142.263884:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263892:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2ca7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca82 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263903:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045142.263906:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263911:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784045142.263914:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263919:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045142.263925:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045142.263931:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045142.263949:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263955:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045142.263981:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263988:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2ca0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ca12 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.263997:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045142.263999:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045142.264001:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045142.264016:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829694208:0@lo:103: 00000100:00100000:1.0:1784045142.264043:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045142.267447:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045142.267705:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.267722:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 12 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045142.267737:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1870706829694464:0@lo:104: 00000100:00100000:2.0:1784045142.267796:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.267861:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045142.267889:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1870706829693952:0@lo:104: 00000100:00100000:2.0:1784045142.267899:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1870706829694080:0@lo:104: 00000100:00100000:3.0:1784045142.267985:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694464 00000100:00100000:3.0:1784045142.267992:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694464 00000100:00100000:3.0:1784045142.268047:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045142.268057:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5797:x1870706829694464:12345-0@lo:104: 00010000:00010000:3.0:1784045142.268071:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268136:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045142.268143:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5797:x1870706829694464:12345-0@lo:104: Request processed in 88us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.268150:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1784045142.268172:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045142.268179:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268186:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045142.268196:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268205:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045142.268212:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045142.268218:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045142.268244:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268249:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045142.268258:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268264:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2c9ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2c9f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268279:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045142.268281:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045142.268283:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045142.268336:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829694336:0@lo:103: 00000100:00100000:0.0:1784045142.268368:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.268436:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045142.268442:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829694592:0@lo:103: 00000100:00100000:0.0:1784045142.268463:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.268542:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694208 00000100:00100000:3.0:1784045142.268546:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694208 00010000:00010000:3.0:1784045142.268566:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 13 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.268580:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694336 00000100:00100000:3.0:1784045142.268582:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694336 00010000:00010000:3.0:1784045142.268592:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 14 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.268612:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694592 00000100:00100000:3.0:1784045142.268615:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694592 00010000:00010000:3.0:1784045142.268625:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 15 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.268637:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045142.268643:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:3321:x1870706829694208:12345-0@lo:103: 00010000:00010000:3.0:1784045142.268654:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045142.268660:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 15 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268669:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 15 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268683:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030800/0xdb5b5ff6a2d2ca82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca7b expref: 15 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268696:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045142.268722:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:3321:x1870706829694208:12345-0@lo:103: Request processed in 79us (4678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.268728:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045142.268742:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045142.268748:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:3318:x1870706829694336:12345-0@lo:103: 00010000:00010000:3.0:1784045142.268755:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045142.268759:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 13 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268767:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 13 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268784:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942045c00/0xdb5b5ff6a2d2ca12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ca0b expref: 13 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268795:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045142.268856:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3318:x1870706829694336:12345-0@lo:103: Request processed in 80us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.268863:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045142.268877:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045142.268883:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3318:x1870706829694592:12345-0@lo:103: 00010000:00010000:3.0:1784045142.268890:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045142.268894:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 11 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268903:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 11 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268914:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268922:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268934:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268941:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268949:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268970:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268976:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045142.268981:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268989:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.268998:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.269007:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045142.269028:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3318:x1870706829694592:12345-0@lo:103: Request processed in 145us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.269034:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045142.269142:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829694208:0@lo:103: 00010000:00010000:2.0:1784045142.269241:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2c9f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2c9ef expref: 10 pid: 5796 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045142.269251:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1870706829694464:0@lo:104: 00010000:00010000:2.0:1784045142.269272:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.269281:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.269287:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.269293:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cadd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784045142.269306:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784045142.269423:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829694592:0@lo:103: 00000100:00100000:0.0:1784045142.269431:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829694336:0@lo:103: 00000100:00100000:2.0:1784045142.401617:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:6595:x1870706829693824:12345-0@lo:253: Request processed in 160137us (160442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045142.401633:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045142.401861:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829693824:0@lo:253: 10000000:01000000:0.0:1784045142.401879:0:6595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784045142.401883:0:6595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045142.401884:0:6595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045142.401886:0:6595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045142.401887:0:6595:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1784045142.401889:0:6595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045142.401890:0:6595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045142.401892:0:6595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045142.401894:0:6595:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784045142.401896:0:6595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045142.401897:0:6595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784045142.401921:0:6595:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa907eaf000 from lustre-OST0000 10000000:01000000:0.0:1784045142.401949:0:6595:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784045142.401952:0:6595:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784045142.401969:0:6595:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa907f44d40 local copy 10000000:01000000:0.0:1784045142.401974:0:6595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045142.402016:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.402028:0:6595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.402038:0:6595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045142.402057:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829694720:0@lo:101: 00000100:00100000:0.0:1784045142.402095:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.402147:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045142.402217:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694720 00000100:00100000:2.0:1784045142.402226:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694720 00000100:00100000:2.0:1784045142.402277:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784045142.402286:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:6595:x1870706829694720:12345-0@lo:101: 00010000:00010000:2.0:1784045142.402303:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045142.402319:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2caeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cae4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.402344:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2caeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cae4 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.402374:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2caeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cae4 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.402383:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045142.402416:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:6595:x1870706829694720:12345-0@lo:101: Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045142.402422:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045142.402509:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829694720:0@lo:101: 00010000:00010000:0.0:1784045142.402524:0:6595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.402540:0:6595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045142.402641:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829694848:0@lo:501: 00000100:00100000:0.0:1784045142.402666:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.402691:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045142.402744:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694848 00000100:00100000:2.0:1784045142.402748:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694848 00000100:00100000:2.0:1784045142.402815:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784045142.402823:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:6595:x1870706829694848:12345-0@lo:501: 00000100:00100000:2.0:1784045142.403101:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:6595:x1870706829694848:12345-0@lo:501: Request processed in 278us (433us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045142.403108:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045142.403178:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829694848:0@lo:501: 10000000:01000000:3.0:1784045142.403192:0:6595:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784045142.403220:0:6595:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784045142.403226:0:6595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403233:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403240:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403268:0:6595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045142.403287:0:6595:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa907eaf000 10000000:01000000:3.0:1784045142.403292:0:6595:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784045142.403297:0:6595:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8aa907f44d40 10000000:01000000:3.0:1784045142.403299:0:6595:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784045142.403303:0:6595:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8aa907f44d40 from 1 10000000:01000000:3.0:1784045142.403305:0:6595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784045142.403325:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403333:0:6595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403339:0:6595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.403351:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829694976:0@lo:101: 00000100:00100000:3.0:1784045142.403380:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.403559:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9344ce840 going to sleep for 11 seconds 00010000:00010000:3.0:1784045142.403575:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045142.403581:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403590:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045142.403594:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403602:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045142.403621:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045142.403627:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045142.403647:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403654:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045142.403674:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403682:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2cae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdb5b5ff6a2d2caeb expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.403696:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045142.403698:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045142.403700:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045142.411098:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829694976 00000100:00100000:0.0:1784045142.411113:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829694976 00000100:00100000:0.0:1784045142.411171:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829695104:0@lo:103: 00000100:00100000:0.0:1784045142.411242:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.411339:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045142.411347:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:6595:x1870706829694976:12345-0@lo:101: 00010000:00010000:0.0:1784045142.411364:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045142.411385:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031c00/0xdb5b5ff6a2d2caf9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2caf2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.411412:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031c00/0xdb5b5ff6a2d2caf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caf2 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.411424:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031c00/0xdb5b5ff6a2d2caf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caf2 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.411433:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031c00, rc 0) 00000100:00100000:0.0:1784045142.411476:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829694976:12345-0@lo:101: Request processed in 130us (8094us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.411483:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784045142.411987:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695104 00000100:00100000:3.0:1784045142.411992:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695104 00000100:00100000:3.0:1784045142.412033:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045142.412040:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3320:x1870706829695104:12345-0@lo:103: 00010000:00010000:3.0:1784045142.412050:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045142.412066:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2caeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cae4 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.412085:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045142.412117:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:3320:x1870706829695104:12345-0@lo:103: Request processed in 78us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.412123:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045142.412182:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829694976:0@lo:101: 00010000:00010000:3.0:1784045142.412198:0:6595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.412208:0:6595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045142.412229:0:6595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784045142.412240:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.412248:0:6595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045142.412256:0:6595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784045142.412260:0:6595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045142.412267:0:6595:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784045142.412269:0:6595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784045142.412291:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.412299:0:6595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.412308:0:6595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.412325:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695232:0@lo:101: 00000100:00100000:3.0:1784045142.412354:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.412375:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9344ce840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045142.413957:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829695104:0@lo:103: 00000100:00100000:0.0:1784045142.414016:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695232 00000100:00100000:0.0:1784045142.414022:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695232 00000100:00100000:0.0:1784045142.414057:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045142.414065:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+10:6595:x1870706829695232:12345-0@lo:101: 00010000:00010000:0.0:1784045142.414083:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045142.414104:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.414134:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.414145:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.414154:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031e00, rc 0) 00000100:00100000:0.0:1784045142.414220:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695232:12345-0@lo:101: Request processed in 155us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.414227:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784045142.414472:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695232:0@lo:101: 00010000:00010000:3.0:1784045142.414491:0:6595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.414501:0:6595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.414630:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695360:0@lo:501: 00000100:00100000:3.0:1784045142.414663:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.414689:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9344ce840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045142.414817:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695360 00000100:00100000:2.0:1784045142.414822:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695360 00000100:00100000:3.0:1784045142.415055:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045142.415062:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695360:12345-0@lo:501: 00000100:00100000:3.0:1784045142.415315:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695360:12345-0@lo:501: Request processed in 253us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.415322:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784045142.415467:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695360:0@lo:501: 00000100:00100000:2.0:1784045142.415500:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695488:0@lo:503: 00000100:00100000:2.0:1784045142.415550:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.415778:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937f149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045142.418280:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695488 00000100:00100000:1.0:1784045142.418294:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695488 00000100:00100000:0.0:1784045142.424501:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784045142.424545:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695488:12345-0@lo:503: 00000100:00100000:0.0:1784045142.425114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695488:12345-0@lo:503: Request processed in 597us (9560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.425125:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784045142.428038:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695488:0@lo:503: 00000040:00080000:2.0:1784045142.428361:0:6595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045142.428440:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695616:0@lo:502: 00000100:00100000:2.0:1784045142.428515:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.430099:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045142.430159:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695616 00000100:00100000:2.0:1784045142.430167:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695616 00000100:00100000:0.0:1784045142.432126:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045142.432238:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695616:12345-0@lo:502: 00000100:00100000:3.0:1784045142.432520:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695616:12345-0@lo:502: Request processed in 382us (4004us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.432528:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045142.432633:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695616:0@lo:502: 00000040:00080000:0.0:1784045142.433209:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784045142.433268:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784045142.433315:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784045142.433361:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784045142.433394:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784045142.433424:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784045142.433462:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695744:0@lo:502: 00000100:00100000:0.0:1784045142.433514:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.433611:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045142.435188:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695744 00000100:00100000:3.0:1784045142.435200:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695744 00000100:00100000:3.0:1784045142.435246:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045142.435255:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695744:12345-0@lo:502: 00000100:00100000:3.0:1784045142.435486:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695744:12345-0@lo:502: Request processed in 232us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.435494:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784045142.435616:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695744:0@lo:502: 00000040:00080000:2.0:1784045142.435768:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784045142.435784:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1784045142.436607:0:6615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784045142.436615:0:6615:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1784045142.436621:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045142.436623:0:6615:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784045142.436629:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045142.436642:0:6615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8aa93b594d40) 00000020:00000080:2.0:1784045142.436662:0:6615:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784045142.436667:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784045142.436726:0:6615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa907eaf000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784045142.436732:0:6615:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784045142.436739:0:6615:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb5b5ff6a2d2cb15 00010000:00010000:3.0:1784045142.449580:0:6615:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1784045142.450285:0:6615:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784045142.457547:0:6615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784045142.460691:0:6615:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784045142.486898:0:6615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784045142.487373:0:6615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784045142.501371:0:6615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784045142.501385:0:6615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045142.501393:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045142.501395:0:6615:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784045142.501399:0:6615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045142.501404:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045142.501405:0:6615:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045142.501408:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045142.501410:0:6615:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784045142.501470:0:6615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045142.501474:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045142.501475:0:6615:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045142.501478:0:6615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784045142.501890:0:6595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784045142.501920:0:6595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784045142.501935:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.501948:0:6595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045142.501956:0:6595:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa907eaf000 from 1 10000000:01000000:3.0:1784045142.501971:0:6595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045142.502008:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.502016:0:6595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.502028:0:6595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.502052:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695872:0@lo:101: 00000100:00100000:3.0:1784045142.502119:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.502158:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa905030480 going to sleep for 11 seconds 00000100:00100000:3.0:1784045142.502183:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829695872 00000100:00100000:3.0:1784045142.502190:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829695872 00000100:00100000:3.0:1784045142.502247:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045142.502254:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:6595:x1870706829695872:12345-0@lo:101: 00010000:00010000:3.0:1784045142.502268:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045142.502280:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb1c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.502301:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.502312:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.502319:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ea00, rc 0) 00000100:00100000:3.0:1784045142.502354:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829695872:12345-0@lo:101: Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.502361:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045142.502406:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829695872:0@lo:101: 00010000:00010000:3.0:1784045142.502420:0:6595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.502429:0:6595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045142.502502:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696000:0@lo:501: 00000100:00100000:3.0:1784045142.502524:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.502541:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa905030480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045142.516155:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696000 00000100:00100000:1.0:1784045142.516173:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696000 00000100:00100000:1.0:1784045142.516232:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045142.516242:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696000:12345-0@lo:501: 00000100:00100000:1.0:1784045142.516552:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696000:12345-0@lo:501: Request processed in 310us (14025us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045142.516560:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045142.522365:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696000:0@lo:501: 00000100:00100000:0.0:1784045142.522446:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696128:0@lo:503: 00000100:00100000:0.0:1784045142.522532:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.522576:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045142.522668:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696128 00000100:00100000:3.0:1784045142.522676:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696128 00000100:00100000:3.0:1784045142.522730:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045142.522750:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696128:12345-0@lo:503: 00000100:00100000:3.0:1784045142.523055:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696128:12345-0@lo:503: Request processed in 305us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.523063:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784045142.523272:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696128:0@lo:503: 00000040:00080000:0.0:1784045142.523564:0:6595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784045142.523632:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696256:0@lo:502: 00000100:00100000:0.0:1784045142.523674:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.523708:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045142.523758:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696256 00000100:00100000:3.0:1784045142.523763:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696256 00000100:00100000:3.0:1784045142.523800:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045142.523807:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696256:12345-0@lo:502: 00000100:00100000:3.0:1784045142.524005:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696256:12345-0@lo:502: Request processed in 197us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.524013:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784045142.525055:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696256:0@lo:502: 00000040:00080000:0.0:1784045142.525363:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784045142.525422:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784045142.525455:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696384:0@lo:502: 00000100:00100000:0.0:1784045142.525506:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.525597:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045142.531055:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696384 00000100:00100000:3.0:1784045142.531072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696384 00000100:00100000:2.0:1784045142.535159:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784045142.535174:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696384:12345-0@lo:502: 00000100:00100000:2.0:1784045142.535514:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696384:12345-0@lo:502: Request processed in 342us (10007us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045142.535529:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784045142.541112:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696384:0@lo:502: 00000040:00080000:0.0:1784045142.541322:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784045142.541339:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784045142.542946:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045142.542978:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045142.542981:0:6619:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784045142.542987:0:6619:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa907eaf000 00000020:00000080:0.0:1784045142.542989:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045142.543013:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045142.543016:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045142.543018:0:6619:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784045142.543021:0:6619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784045142.543174:0:6595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784045142.543197:0:6595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045142.543221:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.543232:0:6595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045142.543273:0:6595:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784045142.543275:0:6595:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa907eaf000 10000000:01000000:2.0:1784045142.543279:0:6595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa907eaf000 10000000:01000000:2.0:1784045142.543283:0:6595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784045142.543288:0:6595:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa907eaf000 from 1 10000000:01000000:2.0:1784045142.543290:0:6595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045142.543328:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.543336:0:6595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.543347:0:6595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045142.543369:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696512:0@lo:101: 00000100:00100000:2.0:1784045142.543436:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.543503:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045142.543651:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696512 00000100:00100000:0.0:1784045142.543657:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696512 00000100:00100000:0.0:1784045142.543705:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784045142.543715:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829696512:12345-0@lo:101: 00010000:00010000:0.0:1784045142.543731:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045142.543747:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb2a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.543772:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.543785:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.543795:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030600, rc 0) 00000100:00100000:0.0:1784045142.543873:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696512:12345-0@lo:101: Request processed in 159us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.543881:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784045142.544030:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696512:0@lo:101: 00010000:00010000:2.0:1784045142.544045:0:6595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045142.544062:0:6595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045142.544151:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696640:0@lo:501: 00000100:00100000:2.0:1784045142.544178:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.544252:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045142.545752:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696640 00000100:00100000:3.0:1784045142.545763:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696640 00000100:00100000:3.0:1784045142.545888:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784045142.545897:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696640:12345-0@lo:501: 00000100:00100000:3.0:1784045142.546186:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696640:12345-0@lo:501: Request processed in 290us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045142.546194:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045142.546297:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696640:0@lo:501: 00000100:00100000:2.0:1784045142.546341:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696768:0@lo:503: 00000100:00100000:2.0:1784045142.546386:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.546763:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045142.547056:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696768 00000100:00100000:0.0:1784045142.547063:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696768 00000100:00100000:0.0:1784045142.547095:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045142.547103:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696768:12345-0@lo:503: 00000100:00100000:0.0:1784045142.547290:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696768:12345-0@lo:503: Request processed in 186us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.547297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784045142.547375:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696768:0@lo:503: 00000040:00080000:2.0:1784045142.547666:0:6595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045142.547743:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696896:0@lo:502: 00000100:00100000:2.0:1784045142.547783:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.547818:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045142.547974:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829696896 00000100:00100000:0.0:1784045142.547979:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829696896 00000100:00100000:0.0:1784045142.548001:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784045142.548008:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696896:12345-0@lo:502: 00000100:00100000:0.0:1784045142.548175:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829696896:12345-0@lo:502: Request processed in 166us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.548181:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045142.548256:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829696896:0@lo:502: 00000040:00080000:2.0:1784045142.548493:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784045142.548540:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784045142.548576:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784045142.548622:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784045142.548676:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784045142.548722:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784045142.548756:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784045142.548786:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784045142.548899:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784045142.548938:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784045142.548998:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784045142.549043:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784045142.549078:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784045142.549111:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784045142.549156:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784045142.549205:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784045142.549242:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784045142.549293:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784045142.549330:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784045142.549363:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784045142.549410:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784045142.549446:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784045142.549477:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784045142.549520:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784045142.549552:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784045142.549582:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784045142.549625:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784045142.549658:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1784045142.549696:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829697024:0@lo:502: 00000100:00100000:2.0:1784045142.549752:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.549789:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045142.550072:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697024 00000100:00100000:0.0:1784045142.550079:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697024 00000100:00100000:0.0:1784045142.550115:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784045142.550123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829697024:12345-0@lo:502: 00000100:00100000:0.0:1784045142.550334:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829697024:12345-0@lo:502: Request processed in 211us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.550341:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045142.550503:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829697024:0@lo:502: 00000040:00080000:2.0:1784045142.550577:0:6595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784045142.550588:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1784045142.558065:0:6620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784045142.558084:0:6620:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8aa93b593380) 00000020:00000080:2.0:1784045142.558128:0:6620:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1784045142.558304:0:6620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa907eaf000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784045142.558309:0:6620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa907eaf000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784045142.558312:0:6620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa907eaf000 3 00010000:00080000:2.0:1784045142.558339:0:6620:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa93fa79800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.158@tcp at head 00010000:00010000:2.0:1784045142.563256:0:6620:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1784045142.563352:0:6620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784045142.563386:0:6620:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784045142.563790:0:6620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdb5b5ff6a2d2cb3f 00000100:00080000:2.0:1784045142.563802:0:6620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045142.563808:0:6620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8aa93fa79800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045142.563864:0:6620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937743800 x1870706829697152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045142.563892:0:6620:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784045142.563994:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829697280:0@lo:400: 00000100:00100000:2.0:1784045142.564057:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045142.564121:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697280 00000100:00100000:2.0:1784045142.564128:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697280 00000100:00100000:2.0:1784045142.564171:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045142.564180:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829697280:12345-0@lo:400: 00000100:00100000:2.0:1784045142.564231:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829697280:12345-0@lo:400: Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045142.564238:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784045142.564271:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa937740000 x1870706829697280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045142.564285:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829697280:0@lo:400: 00000100:00100000:3.0:1784045142.564386:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829697152:0@lo:38: 00000100:00100000:3.0:1784045142.564416:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045142.566801:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697152 00000100:00100000:1.0:1784045142.566816:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697152 00000100:00100000:1.0:1784045142.566903:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045142.566911:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1870706829697152:12345-0@lo:38: 00010000:00080000:1.0:1784045142.566952:0:5806:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:1.0:1784045142.566995:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb5b5ff6a2d2cb46 00000004:00100000:1.0:1784045142.567014:0:5806:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784045142.567045:0:5806:0:(import.c:65:import_set_state_nolock()) ffff8aa93f8b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045142.567131:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1870706829697152:12345-0@lo:38: Request processed in 219us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045142.567138:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784045142.567191:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa937743800 x1870706829697152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045142.567203:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045142.567212:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784045142.567218:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784045142.567223:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784045142.567225:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93fa79800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784045142.567232:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829697152:0@lo:38: 00000040:00080000:3.0:1784045142.567669:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1784045142.567789:0:6595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1784045142.567815:0:6595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784045142.567854:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045142.567882:0:6595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784045142.567948:0:6595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784045142.567950:0:6595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045142.567952:0:6595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045142.567953:0:6595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045142.567954:0:6595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045142.567955:0:6595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045142.567966:0:6595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045142.567969:0:6595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045142.567970:0:6595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045142.567973:0:6595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045142.567974:0:6595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045142.567978:0:6595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1784045142.567980:0:6595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045142.567982:0:6595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045142.567983:0:6595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045142.567984:0:6595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045142.567985:0:6595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045142.567986:0:6595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045142.567987:0:6595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045142.567988:0:6595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045142.567989:0:6595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045142.567990:0:6595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045142.567991:0:6595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045142.568013:0:6595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784045142.568031:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829697408:0@lo:253: 00000100:00100000:3.0:1784045142.568084:0:6595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045142.568114:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930353180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045142.568222:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697408 00000100:00100000:1.0:1784045142.568228:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697408 00000100:00100000:1.0:1784045142.568271:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045142.568278:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6595:x1870706829697408:12345-0@lo:253: 20000000:01000000:1.0:1784045142.568303:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784045142.568321:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784045142.639441:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784045142.639462:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784045142.639518:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784045142.639523:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784045142.639548:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.639569:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.639592:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.639725:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045142.639741:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 13 pid: 5799 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045142.639821:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1870706829697536:0@lo:104: 00000100:00100000:1.0:1784045142.639910:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045142.639985:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910da8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045142.640393:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697536 00000100:00100000:0.0:1784045142.640400:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697536 00000100:00100000:0.0:1784045142.640448:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045142.640457:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5820:x1870706829697536:12345-0@lo:104: 00010000:00010000:0.0:1784045142.640471:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.640526:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045142.640539:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5820:x1870706829697536:12345-0@lo:104: Request processed in 84us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.640548:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1784045142.640574:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045142.640581:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.640589:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045142.640593:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.640602:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045142.640612:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045142.640618:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045142.640664:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.640672:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045142.640689:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.640696:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900031400/0xdb5b5ff6a2d2caa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2caac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.640713:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045142.640715:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045142.640717:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045142.640744:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829697664:0@lo:103: 00000100:00100000:0.0:1784045142.640953:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045142.641019:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697664 00000100:00100000:0.0:1784045142.641024:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697664 00010000:00010000:0.0:1784045142.641044:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 14 pid: 5799 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045142.641065:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045142.641071:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:3318:x1870706829697664:12345-0@lo:103: 00010000:00010000:0.0:1784045142.641082:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045142.641087:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 14 pid: 5799 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641097:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 14 pid: 5799 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641114:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641123:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784045142.641137:0:5791:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004726918s 00010000:00010000:0.0:1784045142.641141:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641148:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641155:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641172:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641178:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045142.641183:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641191:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641199:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641209:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045142.641237:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:3318:x1870706829697664:12345-0@lo:103: Request processed in 166us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045142.641244:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045142.641307:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829697664:0@lo:103: 00010000:00010000:0.0:1784045142.641333:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2caac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caa5 expref: 13 pid: 5799 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045142.641343:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1870706829697536:0@lo:104: 00010000:00010000:0.0:1784045142.641356:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641364:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641370:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045142.641383:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cb4d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045142.669467:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:6595:x1870706829697408:12345-0@lo:253: Request processed in 101182us (101375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045142.669482:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784045142.669585:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6595:1870706829697408:0@lo:253: 10000000:01000000:3.0:1784045142.669600:0:6595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784045142.669603:0:6595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045142.669605:0:6595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045142.669618:0:6595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045142.669619:0:6595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045142.669621:0:6595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045142.669622:0:6595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045142.669623:0:6595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045142.669625:0:6595:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045142.669627:0:6595:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045142.669629:0:6595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045142.669630:0:6595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784045142.669644:0:6595:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784045142.675292:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045142.675519:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045142.675721:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045142.677266:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045142.677479:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045142.677703:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784045142.679236:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1784045142.985801:0:6595:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784045142.985806:0:6595:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784045142.985859:0:6595:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784045142.985911:0:6595:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784045142.985928:0:6595:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784045142.985960:0:6595:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784045143.265396:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045144.306694:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045145.317864:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045146.337621:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045147.364441:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045148.065462:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045148.065487:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829697792:0@lo:400: 00000100:00100000:3.0:1784045148.065558:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045148.065581:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829697920:0@lo:400: 00000100:00100000:0.0:1784045148.065612:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045148.065634:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045148.065640:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829698048:0@lo:400: 00000100:00100000:0.0:1784045148.065663:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045148.065689:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697920 00000100:00100000:0.0:1784045148.065696:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697920 00000100:00100000:0.0:1784045148.065733:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698048 00000100:00100000:0.0:1784045148.065735:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698048 00000100:00100000:0.0:1784045148.065758:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045148.065766:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829697920:12345-0@lo:400: 00000100:00100000:0.0:1784045148.065817:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829697920:12345-0@lo:400: Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045148.065825:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045148.065862:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045148.065881:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829698048:12345-0@lo:400: 00000100:00100000:0.0:1784045148.065911:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829698048:12345-0@lo:400: Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045148.065917:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784045148.065949:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad180 x1870706829698048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045148.065975:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829698048:0@lo:400: 00010000:00080000:0.0:1784045148.065988:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ac700 x1870706829697920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045148.065996:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829697920:0@lo:400: 00000100:00100000:1.0:1784045148.066395:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829697792 00000100:00100000:1.0:1784045148.066400:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829697792 00000100:00100000:1.0:1784045148.066432:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784045148.066439:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3318:x1870706829697792:12345-0@lo:400: 00000100:00100000:1.0:1784045148.066477:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3318:x1870706829697792:12345-0@lo:400: Request processed in 39us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045148.066483:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1784045148.066508:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045148.066541:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829697792:0@lo:400: 00010000:00010000:3.0:1784045148.387918:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045149.413255:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784045150.117174:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784045150.117187:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa90538d800 from 21 10000000:01000000:1.0:1784045150.117193:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045150.117239:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.117252:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.117264:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045150.117289:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698176:0@lo:101: 00000100:00100000:1.0:1784045150.117357:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045150.117405:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.117495:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698176 00000100:00100000:0.0:1784045150.117502:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698176 00000100:00100000:0.0:1784045150.117560:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045150.117571:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829698176:12345-0@lo:101: 00010000:00010000:0.0:1784045150.117584:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045150.117598:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb54 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.117624:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.117634:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.117643:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031600, rc 0) 00000100:00100000:0.0:1784045150.117681:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829698176:12345-0@lo:101: Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.117688:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045150.117729:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698176:0@lo:101: 00010000:00010000:0.0:1784045150.117744:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.117766:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.117855:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698304:0@lo:501: 00000100:00100000:0.0:1784045150.117879:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.117907:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045150.117930:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698304 00000100:00100000:3.0:1784045150.117936:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698304 00000100:00100000:3.0:1784045150.117968:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784045150.117975:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829698304:12345-0@lo:501: 00000100:00100000:3.0:1784045150.119098:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829698304:12345-0@lo:501: Request processed in 1120us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045150.119107:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784045150.119199:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698304:0@lo:501: 00000100:00100000:1.0:1784045150.119242:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698432:0@lo:503: 00000100:00100000:1.0:1784045150.119286:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045150.119317:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045150.119322:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698432 00000100:00100000:3.0:1784045150.119328:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698432 00000100:00100000:3.0:1784045150.119403:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784045150.119412:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829698432:12345-0@lo:503: 00000100:00100000:3.0:1784045150.119759:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829698432:12345-0@lo:503: Request processed in 348us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045150.119766:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784045150.120798:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698432:0@lo:503: 00000100:00100000:1.0:1784045150.122270:0:6926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6926:1870706829698560:0@lo:502: 00000100:00100000:1.0:1784045150.122344:0:6926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045150.122389:0:6926:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa8029719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.123281:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698560 00000100:00100000:0.0:1784045150.123290:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698560 00000100:00100000:0.0:1784045150.123354:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045150.123364:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6926:x1870706829698560:12345-0@lo:502: 00000100:00100000:0.0:1784045150.123701:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6926:x1870706829698560:12345-0@lo:502: Request processed in 338us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.123710:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784045150.123905:0:6926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6926:1870706829698560:0@lo:502: 00000100:00100000:1.0:1784045150.123965:0:6926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6926:1870706829698688:0@lo:502: 00000100:00100000:1.0:1784045150.124004:0:6926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045150.124036:0:6926:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa8029719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.125527:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698688 00000100:00100000:0.0:1784045150.125537:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698688 00000100:00100000:0.0:1784045150.125595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045150.125604:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6926:x1870706829698688:12345-0@lo:502: 00000100:00100000:0.0:1784045150.125857:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:6926:x1870706829698688:12345-0@lo:502: Request processed in 225us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.125866:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784045150.125903:0:6926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6926:1870706829698688:0@lo:502: 00000040:00080000:1.0:1784045150.125937:0:6926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784045150.126231:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784045150.126248:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045150.126258:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.126269:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045150.126286:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784045150.126289:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa90538d800 from 4 10000000:01000000:0.0:1784045150.126292:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784045150.126331:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.126340:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.126349:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.126366:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698816:0@lo:101: 00000100:00100000:0.0:1784045150.126399:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.126426:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045150.127066:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698816 00000100:00100000:1.0:1784045150.127073:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698816 00000100:00100000:1.0:1784045150.127116:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784045150.127124:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829698816:12345-0@lo:101: 00010000:00010000:1.0:1784045150.127135:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045150.127163:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb62 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.127186:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.127197:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.127205:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172200, rc 0) 00000100:00100000:1.0:1784045150.127255:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829698816:12345-0@lo:101: Request processed in 132us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045150.127261:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045150.127390:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698816:0@lo:101: 00010000:00010000:0.0:1784045150.127405:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.127415:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.127464:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698944:0@lo:256: 00000100:00100000:0.0:1784045150.127496:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.127523:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045150.127570:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829698944 00000100:00100000:1.0:1784045150.127575:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829698944 00000100:00100000:1.0:1784045150.127603:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045150.127609:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829698944:12345-0@lo:256: 20000000:01000000:1.0:1784045150.127622:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784045150.127638:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784045150.127641:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1784045150.127708:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829698944:12345-0@lo:256: Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045150.127714:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784045150.127775:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829698944:0@lo:256: 10000000:01000000:0.0:1784045150.127823:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784045150.127860:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.127868:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045150.127875:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784045150.127877:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1784045150.127880:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784045150.127896:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.127903:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.127911:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.127922:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829699072:0@lo:101: 00000100:00100000:0.0:1784045150.127960:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.127975:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045150.128261:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699072 00000100:00100000:1.0:1784045150.128270:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699072 00000100:00100000:1.0:1784045150.128364:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045150.128374:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829699072:12345-0@lo:101: 00010000:00010000:1.0:1784045150.128382:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045150.128392:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb70 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.128410:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.128419:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045150.128427:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173c00, rc 0) 00000100:00100000:1.0:1784045150.128456:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829699072:12345-0@lo:101: Request processed in 84us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045150.128462:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784045150.128529:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829699072:0@lo:101: 00010000:00010000:0.0:1784045150.128541:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.128548:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.128590:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829699200:0@lo:501: 00000100:00100000:0.0:1784045150.128623:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.128647:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.128660:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699200 00000100:00100000:0.0:1784045150.128663:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699200 00000100:00100000:0.0:1784045150.128689:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784045150.128696:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829699200:12345-0@lo:501: 00000100:00100000:0.0:1784045150.129452:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829699200:12345-0@lo:501: Request processed in 754us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.129459:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784045150.129497:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829699200:0@lo:501: 00000100:00100000:0.0:1784045150.129528:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829699328:0@lo:503: 00000100:00100000:0.0:1784045150.129564:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.129584:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.129597:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699328 00000100:00100000:0.0:1784045150.129600:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699328 00000100:00100000:0.0:1784045150.129623:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045150.129629:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829699328:12345-0@lo:503: 00000100:00100000:0.0:1784045150.130292:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829699328:12345-0@lo:503: Request processed in 661us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045150.130396:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829699328:0@lo:503: 00000100:00100000:0.0:1784045150.130454:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045150.130764:0:6929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6929:1870706829699456:0@lo:502: 00000100:00100000:0.0:1784045150.131514:0:6929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.131552:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699456 00000100:00100000:0.0:1784045150.131558:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699456 00000100:00100000:0.0:1784045150.131591:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784045150.131598:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:6929:x1870706829699456:12345-0@lo:502: 00000100:00100000:1.0:1784045150.134340:0:6929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9344ced80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.136182:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:6929:x1870706829699456:12345-0@lo:502: Request processed in 4577us (5372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.136195:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784045150.136354:0:6929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6929:1870706829699456:0@lo:502: 00000020:01000000:1.0:1784045150.136391:0:6929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784045150.136399:0:6929:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784045150.136406:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045150.136409:0:6929:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784045150.136415:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784045150.136418:0:6929:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1784045150.136440:0:6929:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784045150.136443:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784045150.136478:0:6929:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8aa907e919c0) 00000020:00000080:1.0:1784045150.136499:0:6929:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784045150.136510:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784045150.136720:0:6929:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784045150.136726:0:6929:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784045150.136733:0:6929:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2cb85 00010000:00080000:1.0:1784045150.136760:0:6929:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa93f8b1000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784045150.137025:0:6929:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784045150.198897:0:6929:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784045150.198922:0:6929:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784045150.200137:0:6929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045150.200341:0:6929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045150.200415:0:6929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784045150.200477:0:6929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1784045150.201013:0:6931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045150.201017:0:6931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784045150.201734:0:6929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784045150.201746:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784045150.201774:0:6929:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784045150.201794:0:6929:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2cb8c 00000100:00080000:2.0:1784045150.201804:0:6929:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045150.201810:0:6929:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa93f8b1000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045150.201876:0:6929:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937740000 x1870706829699584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045150.201903:0:6929:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1784045150.201933:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829699584:0@lo:8: 00000020:01000000:2.0:1784045150.201956:0:6929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045150.201962:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045150.201964:0:6929:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784045150.201967:0:6929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045150.201971:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045150.201973:0:6929:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045150.201976:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045150.201978:0:6929:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784045150.202003:0:6929:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6929:1870706829699712:0@lo:502: 00000100:00100000:0.0:1784045150.202019:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045150.202063:0:6929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045150.202086:0:6929:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93017b780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.202096:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699584 00000100:00100000:0.0:1784045150.202104:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699584 00000100:00100000:2.0:1784045150.202148:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699712 00000100:00100000:2.0:1784045150.202152:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699712 00000100:00100000:2.0:1784045150.202183:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045150.202191:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:6929:x1870706829699712:12345-0@lo:502: 00000100:00100000:0.0:1784045150.202254:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045150.202261:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3317:x1870706829699584:12345-0@lo:8: 00010000:00080000:0.0:1784045150.202282:0:6598:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1784045150.202321:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2cb93 00002000:00100000:0.0:1784045150.202354:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8aa937e2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784045150.202360:0:6598:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1784045150.202364:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784045150.202496:0:6598:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784045150.202532:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:6929:x1870706829699712:12345-0@lo:502: Request processed in 340us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045150.202550:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045150.202599:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829699840:0@lo:400: 00000100:00100000:2.0:1784045150.202634:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045150.202656:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045150.202662:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829699968:0@lo:400: 00000100:00100000:2.0:1784045150.202683:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045150.202723:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699840 00000100:00100000:2.0:1784045150.202727:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699840 00002000:00080000:0.0:1784045150.202743:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1784045150.202756:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829699968 00000100:00100000:2.0:1784045150.202760:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829699968 00000100:00080000:0.0:1784045150.202767:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8aa937e2b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045150.202788:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045150.202797:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829699840:12345-0@lo:400: 00000100:00100000:0.0:1784045150.202816:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1870706829699584:12345-0@lo:8: Request processed in 553us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.202824:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045150.202876:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829699840:12345-0@lo:400: Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045150.202884:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045150.202897:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045150.202904:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829699968:12345-0@lo:400: 00000100:00100000:2.0:1784045150.202930:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829699968:12345-0@lo:400: Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045150.202937:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1784045150.202961:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784045150.203197:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937740000 x1870706829699584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045150.203208:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045150.203215:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784045150.203223:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784045150.203227:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784045150.203237:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f8b1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784045150.203249:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784045150.203253:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829699584:0@lo:8: 00010000:00080000:2.0:1784045150.203490:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937740e00 x1870706829699968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045150.203504:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829699968:0@lo:400: 00010000:00080000:2.0:1784045150.203518:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937740a80 x1870706829699840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045150.203541:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829699840:0@lo:400: 00000100:00100000:2.0:1784045150.203569:0:6929:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:6929:1870706829699712:0@lo:502: 00000020:01000000:2.0:1784045150.203592:0:6929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045150.203598:0:6929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045150.203600:0:6929:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045150.203603:0:6929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1784045150.203732:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1784045150.203753:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784045150.203763:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.203775:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045150.203785:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784045150.203788:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa907f44d40 from 1 10000000:01000000:0.0:1784045150.203791:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045150.203821:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.203859:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.203870:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.203889:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829700096:0@lo:101: 00000100:00100000:0.0:1784045150.203927:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.203968:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93a1a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.203988:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700096 00000100:00100000:0.0:1784045150.203993:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700096 00000100:00100000:0.0:1784045150.204027:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784045150.204036:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829700096:12345-0@lo:101: 00010000:00010000:0.0:1784045150.204059:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045150.204074:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cb9a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.204096:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.204106:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.204115:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030400, rc 0) 00000004:00080000:2.0:1784045150.204245:0:6931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784045150.204419:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829700096:12345-0@lo:101: Request processed in 384us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.204426:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784045150.204474:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829700096:0@lo:101: 00010000:00010000:0.0:1784045150.204486:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.204495:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045150.204543:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829700224:0@lo:501: 00000100:00100000:0.0:1784045150.204575:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.204602:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93a1a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045150.204604:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700224 00000100:00100000:2.0:1784045150.204610:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700224 00000100:00100000:2.0:1784045150.204635:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784045150.204643:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829700224:12345-0@lo:501: 00000100:00100000:2.0:1784045150.204820:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829700224:12345-0@lo:501: Request processed in 178us (244us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045150.204856:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:2.0:1784045150.204916:0:6931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 184891084889ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784045150.204940:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829700224:0@lo:501: 10000000:01000000:0.0:1784045150.204970:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784045150.204976:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045150.204990:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045150.246409:0:6932:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784045150.246443:0:6932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700480:0@lo:7: 00000100:00100000:0.0:1784045150.247602:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.250091:0:6932:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93a1a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045150.250168:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829700352:0@lo:13: 00000100:00100000:0.0:1784045150.250227:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045150.250279:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700352 00000100:00100000:0.0:1784045150.250287:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700352 00000100:00100000:0.0:1784045150.250342:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045150.250351:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829700352:12345-0@lo:13: 00002000:00000024:0.0:1784045150.250391:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1784045150.250439:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829700352:12345-0@lo:13: Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045150.250459:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784045150.250482:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045150.250513:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa90360c700 x1870706829700352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045150.250533:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829700352:0@lo:13: 00000100:00100000:2.0:1784045150.257775:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700480 00000100:00100000:2.0:1784045150.257791:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700480 00000100:00100000:2.0:1784045150.257874:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045150.257884:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6932:x1870706829700480:12345-0@lo:7: 00002000:00080000:2.0:1784045150.277818:0:6600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784045150.277853:0:6600:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784045150.277957:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6932:x1870706829700480:12345-0@lo:7: Request processed in 20071us (30352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045150.277968:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784045150.278031:0:6932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa90360d180 x1870706829700480/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045166 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045150.278056:0:6932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700480:0@lo:7: 00000004:00080000:2.0:1784045150.278070:0:6932:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784045150.278104:0:6932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700608:0@lo:5: 00000100:00100000:2.0:1784045150.278196:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045150.278238:0:6932:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa922359540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045150.278253:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700608 00000100:00100000:2.0:1784045150.278259:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700608 00000100:00100000:2.0:1784045150.278302:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045150.278310:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6932:x1870706829700608:12345-0@lo:5: 00002000:00080000:2.0:1784045150.278336:0:6598:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784045150.278340:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784045150.278542:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6932:x1870706829700608:12345-0@lo:5: Request processed in 233us (345us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784045150.278549:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784045150.278572:0:6932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937741880 x1870706829700608/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045166 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045150.278583:0:6932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700608:0@lo:5: 00000004:00080000:2.0:1784045150.278591:0:6932:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784045150.278614:0:6932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700736:0@lo:700: 00000100:00100000:2.0:1784045150.278636:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045150.278650:0:6932:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa922359540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045150.282484:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700736 00000100:00100000:1.0:1784045150.282500:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700736 00000100:00100000:1.0:1784045150.282567:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045150.282578:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6932:x1870706829700736:12345-0@lo:700: 00000100:00100000:1.0:1784045150.282650:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6606:1870706829700864:0@lo:700: 00000100:00100000:1.0:1784045150.282714:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045150.282745:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa8029716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045150.282776:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700864 00000100:00100000:1.0:1784045150.282780:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700864 00000100:00100000:1.0:1784045150.282805:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045150.282811:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6606:x1870706829700864:12345-0@lo:700: 00000004:00080000:0.0:1784045150.324797:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1784045150.371886:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1784045150.387641:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6606:x1870706829700864:12345-0@lo:700: Request processed in 104818us (104916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045150.387662:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784045150.389604:0:6606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa90abdc000 x1870706829700864/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784045166 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045150.389646:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6606:1870706829700864:0@lo:700: 40000000:02000000:0.0:1784045150.389660:0:6606:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1784045150.450703:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784045150.550559:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784045150.550670:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1784045150.556553:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6932:x1870706829700736:12345-0@lo:700: Request processed in 273966us (277905us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045150.556574:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784045150.556795:0:6932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937740e00 x1870706829700736/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784045166 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045150.556820:0:6932:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784045150.556868:0:6932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700736:0@lo:700: 00000001:02000400:2.0:1784045150.674217:0:6972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:02000040:1.0:1784045150.687667:0:6932:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1784045150.690736:0:6932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700992:0@lo:5: 00000100:00100000:1.0:1784045150.690813:0:6932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045150.699254:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829700992 00000100:00100000:1.0:1784045150.699266:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829700992 00000100:00100000:1.0:1784045150.699318:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045150.699328:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6932:x1870706829700992:12345-0@lo:5: 00000100:00100000:0.0:1784045150.701372:0:6932:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918905240 going to sleep for 11 seconds 00002000:00080000:1.0:1784045150.714303:0:6598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1784045150.714329:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1784045150.730696:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6932:x1870706829700992:12345-0@lo:5: Request processed in 31363us (39875us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784045150.730710:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784045150.732789:0:6932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa90abdd880 x1870706829700992/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045166 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045150.732812:0:6932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6932:1870706829700992:0@lo:5: 00000004:00080000:3.0:1784045150.732860:0:6932:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1784045151.457907:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045152.482544:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045153.506597:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045154.529125:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045155.251940:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829701120:0@lo:400: 00000100:00100000:3.0:1784045155.251946:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829701504:0@lo:400: 00000100:00100000:2.0:1784045155.252897:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045155.255310:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829701248:0@lo:400: 00000100:00100000:2.0:1784045155.255406:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045155.255454:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045155.255461:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829701376:0@lo:400: 00000100:00100000:2.0:1784045155.255485:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045155.255520:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701248 00000100:00100000:2.0:1784045155.255529:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701248 00000100:00100000:2.0:1784045155.255571:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701376 00000100:00100000:2.0:1784045155.255574:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701376 00000100:00100000:2.0:1784045155.255602:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045155.255610:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829701248:12345-0@lo:400: 00000100:00100000:2.0:1784045155.255665:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829701248:12345-0@lo:400: Request processed in 55us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045155.255672:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045155.255689:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045155.255695:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829701376:12345-0@lo:400: 00000100:00100000:2.0:1784045155.255720:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829701376:12345-0@lo:400: Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045155.255726:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1784045155.255783:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad500 x1870706829701376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045155.255798:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829701376:0@lo:400: 00010000:00080000:2.0:1784045155.255809:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ae300 x1870706829701248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045155.255861:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829701248:0@lo:400: 00000100:00100000:0.0:1784045155.262490:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701120 00000100:00100000:0.0:1784045155.262507:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701120 00000100:00100000:0.0:1784045155.262575:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045155.262586:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3321:x1870706829701120:12345-0@lo:400: 00000100:00100000:0.0:1784045155.262689:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3321:x1870706829701120:12345-0@lo:400: Request processed in 105us (9795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045155.262696:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1784045155.262733:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045155.262782:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829701120:0@lo:400: 00000100:00100000:3.0:1784045155.266985:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045155.267112:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701504 00000100:00100000:0.0:1784045155.267121:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701504 00000100:00080000:2.0:1784045155.267184:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045155.267201:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045155.267212:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829701504:12345-0@lo:400: 00000100:00100000:0.0:1784045155.267288:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829701504:12345-0@lo:400: Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045155.267295:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784045155.267373:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0aea00 x1870706829701504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045155.267389:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829701504:0@lo:400: 00010000:00010000:1.0:1784045155.553102:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045155.760293:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829701632:0@lo:13: 00000100:00100000:3.0:1784045155.760362:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045155.760446:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701632 00000100:00100000:3.0:1784045155.760454:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701632 00000100:00100000:3.0:1784045155.760509:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045155.760517:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829701632:12345-0@lo:13: 00002000:00000024:3.0:1784045155.760548:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045155.760594:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829701632:12345-0@lo:13: Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045155.760601:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784045155.760649:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad180 x1870706829701632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045155.760670:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829701632:0@lo:13: 00000001:00080000:2.0:1784045155.836599:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1784045156.578336:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045157.601341:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045158.627483:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045159.650238:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045160.353087:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829702016:0@lo:400: 00000100:00100000:3.0:1784045160.353103:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829702144:0@lo:400: 00000100:00100000:2.0:1784045160.354499:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829701760:0@lo:400: 00000100:00100000:0.0:1784045160.354607:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045160.355136:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045160.355422:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702144 00000100:00100000:1.0:1784045160.355433:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702144 00000100:00100000:1.0:1784045160.358593:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045160.358620:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829702144:12345-0@lo:400: 00000100:00100000:1.0:1784045160.358756:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829702144:12345-0@lo:400: Request processed in 150us (3625us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045160.358764:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045160.358854:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ac000 x1870706829702144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045160.358867:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784045160.358887:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829702144:0@lo:400: 00000100:00100000:2.0:1784045160.359474:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045160.359554:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045160.359568:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829701888:0@lo:400: 00000100:00100000:2.0:1784045160.359610:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045160.359665:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702016 00000100:00100000:2.0:1784045160.359672:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702016 00000100:00100000:2.0:1784045160.359720:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701888 00000100:00100000:2.0:1784045160.359723:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701888 00000100:00100000:2.0:1784045160.359739:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045160.359748:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829702016:12345-0@lo:400: 00000100:00100000:2.0:1784045160.359853:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829702016:12345-0@lo:400: Request processed in 106us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045160.359860:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045160.359877:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045160.359883:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829701888:12345-0@lo:400: 00000100:00100000:2.0:1784045160.359914:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829701888:12345-0@lo:400: Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045160.359937:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1784045160.359954:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045160.359958:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045160.359967:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829701760 00000100:00100000:2.0:1784045160.359971:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829701760 00000100:00100000:2.0:1784045160.359995:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784045160.360001:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3318:x1870706829701760:12345-0@lo:400: 00000100:00100000:2.0:1784045160.360044:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3318:x1870706829701760:12345-0@lo:400: Request processed in 44us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045160.360050:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1784045160.360106:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0adc00 x1870706829701888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045160.360118:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829701888:0@lo:400: 00000100:00100000:2.0:1784045160.360128:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829701760:0@lo:400: 00010000:00080000:1.0:1784045160.360690:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad880 x1870706829702016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045160.360708:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829702016:0@lo:400: 00010000:00010000:2.0:1784045160.678944:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045160.871343:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829702272:0@lo:13: 00000100:00100000:2.0:1784045160.871415:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045160.874266:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702272 00000100:00100000:2.0:1784045160.874282:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702272 00000100:00100000:2.0:1784045160.874335:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045160.874344:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829702272:12345-0@lo:13: 00002000:00000024:2.0:1784045160.874410:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045160.874566:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829702272:12345-0@lo:13: Request processed in 222us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045160.874574:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784045160.874704:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0afb80 x1870706829702272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045160.874726:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829702272:0@lo:13: 00010000:00010000:1.0:1784045161.697040:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045162.723304:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045163.749441:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784045163.994460:0:7491:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784045163.994465:0:7491:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1784045163.995410:0:7491:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8aa93f779800 00000020:01000004:2.0:1784045163.995430:0:7491:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784045163.995444:0:7491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1784045163.995470:0:7491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8aa9101499c0) 00000020:00000080:2.0:1784045163.995486:0:7491:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784045164.021069:0:7491:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784045164.021324:0:7491:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784045164.065058:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784045164.071514:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784045164.071545:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784045164.071611:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784045164.071636:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784045164.072368:0:7491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784045164.072379:0:7491:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045164.072390:0:7491:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdb5b5ff6a2d2cbaf 00000020:01000004:2.0:1784045164.072398:0:7491:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784045164.072419:0:7491:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784045164.072423:0:7491:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784045164.072429:0:7491:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784045164.072449:0:7491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784045164.072453:0:7491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784045164.132574:0:7491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784045164.132632:0:7491:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.158@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784045164.132638:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784045164.132640:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045164.132652:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045164.132653:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045164.132655:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045164.132656:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045164.132658:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045164.132660:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045164.132661:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045164.132663:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045164.132859:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045164.132865:0:7491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784045164.132868:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045164.132869:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045164.132870:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045164.132871:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045164.132872:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045164.132874:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045164.132882:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045164.132883:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045164.132884:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045164.132884:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045164.132885:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045164.132912:0:7491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784045164.132932:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829702400:0@lo:253: 00000100:00100000:3.0:1784045164.133002:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.133198:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045164.133350:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702400 00000100:00100000:0.0:1784045164.133358:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702400 00000100:00100000:0.0:1784045164.133443:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045164.133453:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:7491:x1870706829702400:12345-0@lo:253: 20000000:01000000:0.0:1784045164.133497:0:5796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784045164.133502:0:5796:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1784045164.133506:0:5796:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1784045164.133509:0:5796:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784045164.137519:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045164.139224:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1784045164.139253:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784045164.139322:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1784045164.139331:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784045164.139366:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1784045164.139423:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1784045164.140304:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1784045164.140331:0:5796:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:1.0:1784045164.140334:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:1.0:1784045164.140370:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1784045164.140378:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784045164.140428:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1784045164.140437:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:1.0:1784045164.140469:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1784045164.140479:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784045164.140511:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1784045164.140559:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1784045164.151531:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1784045164.151564:0:5796:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:1.0:1784045164.151566:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:1.0:1784045164.151616:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1784045164.151624:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784045164.151656:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1784045164.151663:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:1.0:1784045164.151736:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1784045164.151754:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784045164.151804:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1784045164.151883:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1784045164.151900:0:5796:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784045164.151903:0:5796:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784045164.151906:0:5796:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784045164.151917:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784045164.151919:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784045164.151956:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784045164.151958:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784045164.152529:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1784045164.152940:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1784045164.152980:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1784045164.153047:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1784045164.153060:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784045164.153063:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784045164.154209:0:7493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1784045164.154268:0:7493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1784045164.154320:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1784045164.154603:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1784045164.154655:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1784045164.154720:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1784045164.154733:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784045164.154735:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784045164.155545:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1784045164.155628:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1784045164.155764:0:7494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1784045164.156038:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1784045164.156078:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1784045164.156135:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1784045164.156150:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784045164.156152:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045164.156786:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045164.156876:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045164.156932:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1784045164.157336:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1784045164.157378:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1784045164.157417:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1784045164.157436:0:5796:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1784045164.157439:0:5796:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1784045164.157449:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784045164.157472:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157493:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157502:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157526:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157533:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157540:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157548:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157587:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157614:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 16 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045164.157630:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702528:0@lo:104: 00000100:00100000:0.0:1784045164.157808:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045164.157897:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157906:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 16 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045164.157914:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702656:0@lo:104: 00010000:00010000:0.0:1784045164.157940:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.157960:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 16 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045164.157969:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702784:0@lo:104: 00010000:00010000:0.0:1784045164.157993:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.158000:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 16 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045164.158007:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702912:0@lo:104: 00010000:00010000:0.0:1784045164.158029:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.158037:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 16 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045164.158044:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829703040:0@lo:104: 00000100:00100000:0.0:1784045164.158060:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045164.158146:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784045164.158165:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.158189:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.158198:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.158221:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.158242:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702528 00000100:00100000:2.0:1784045164.158248:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702528 00000100:00100000:2.0:1784045164.158297:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702656 00000100:00100000:2.0:1784045164.158301:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702656 00000100:00100000:2.0:1784045164.158312:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702784 00000100:00100000:2.0:1784045164.158314:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702784 00000100:00100000:2.0:1784045164.158323:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829702912 00000100:00100000:2.0:1784045164.158325:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829702912 00000100:00100000:2.0:1784045164.158333:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703040 00000100:00100000:2.0:1784045164.158336:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703040 00000100:00100000:2.0:1784045164.158347:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045164.158356:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+7:5796:x1870706829702528:12345-0@lo:104: 00010000:00010000:2.0:1784045164.158369:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.158435:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784045164.158440:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+7:5796:x1870706829702528:12345-0@lo:104: Request processed in 86us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.158447:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045164.158487:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045164.158493:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:5796:x1870706829702656:12345-0@lo:104: 00010000:00010000:2.0:1784045164.158500:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.158530:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784045164.158535:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:5796:x1870706829702656:12345-0@lo:104: Request processed in 43us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.158541:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045164.158553:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045164.158566:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:5796:x1870706829702784:12345-0@lo:104: 00010000:00010000:2.0:1784045164.158575:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.158615:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784045164.158620:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:5796:x1870706829702784:12345-0@lo:104: Request processed in 56us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.158626:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045164.158639:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045164.158657:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:5796:x1870706829702912:12345-0@lo:104: 00010000:00010000:2.0:1784045164.158664:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.158697:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784045164.158702:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:5796:x1870706829702912:12345-0@lo:104: Request processed in 47us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.158707:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045164.158719:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045164.158725:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5796:x1870706829703040:12345-0@lo:104: 00010000:00010000:2.0:1784045164.158732:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.158756:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784045164.158760:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5796:x1870706829703040:12345-0@lo:104: Request processed in 36us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.158765:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784045164.158973:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784045164.158982:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.158990:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045164.158995:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159005:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045164.159013:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045164.159019:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045164.159048:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159055:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045164.159085:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159092:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cb9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cba1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159107:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784045164.159111:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159117:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045164.159121:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159127:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045164.159134:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045164.159140:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045164.159154:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159160:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045164.159176:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159182:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2cb70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb77 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159192:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045164.159201:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159207:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045164.159210:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159217:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045164.159223:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045164.159228:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045164.159242:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159248:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045164.159253:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159260:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cb54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159269:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045164.159272:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159277:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045164.159280:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159296:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045164.159302:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045164.159307:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045164.159321:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159328:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045164.159333:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159340:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937720c00/0xdb5b5ff6a2d2cb2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb31 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159351:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045164.159355:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159360:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045164.159363:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159370:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045164.159376:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045164.159387:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045164.159401:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159406:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045164.159410:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159416:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cb00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb07 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.159430:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045164.159432:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045164.159434:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045164.159450:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829703168:0@lo:103: 00000100:00100000:3.0:1784045164.159495:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.159532:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829703680:0@lo:103: 00000100:00100000:3.0:1784045164.159553:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.159573:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045164.159579:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829703552:0@lo:103: 00000100:00100000:3.0:1784045164.159612:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045164.160077:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702528:0@lo:104: 00000100:00100000:1.0:1784045164.160087:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702656:0@lo:104: 00000100:00100000:1.0:1784045164.160094:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702784:0@lo:104: 00000100:00100000:1.0:1784045164.160102:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829702912:0@lo:104: 00000100:00100000:1.0:1784045164.160109:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5796:1870706829703040:0@lo:104: 00010000:00010000:1.0:1784045164.160137:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.160217:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045164.160261:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829703296:0@lo:103: 00000100:00100000:3.0:1784045164.160296:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.160318:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045164.160324:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829703424:0@lo:103: 00000100:00100000:3.0:1784045164.160344:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.160373:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703168 00000100:00100000:3.0:1784045164.160386:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703168 00010000:00010000:3.0:1784045164.160412:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 17 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.160429:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703680 00000100:00100000:3.0:1784045164.160432:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703680 00010000:00010000:3.0:1784045164.160442:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 18 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.160453:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703552 00000100:00100000:3.0:1784045164.160455:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703552 00010000:00010000:3.0:1784045164.160464:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 19 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.160474:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703296 00000100:00100000:3.0:1784045164.160476:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703296 00010000:00010000:3.0:1784045164.160484:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 20 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.160493:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703424 00000100:00100000:3.0:1784045164.160496:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703424 00010000:00010000:3.0:1784045164.160505:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 21 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.160517:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045164.160524:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3319:x1870706829703168:12345-0@lo:103: 00010000:00010000:3.0:1784045164.160536:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045164.160541:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 21 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.160552:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 21 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.160578:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cba1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb9a expref: 21 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.160610:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045164.161063:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784045164.161074:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1784045164.162199:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045164.162213:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3319:x1870706829703680:12345-0@lo:103: 00010000:00010000:1.0:1784045164.162239:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045164.162248:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 20 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.162260:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 20 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.162277:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cb07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb00 expref: 20 pid: 5799 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.162295:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045164.162421:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829703168:12345-0@lo:103: Request processed in 1897us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.162429:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045164.162454:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784045164.162462:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045164.162468:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:3319:x1870706829703552:12345-0@lo:103: 00010000:00010000:3.0:1784045164.162476:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045164.162481:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.162490:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.162500:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cb31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb2a expref: 18 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.162510:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045164.162726:0:7496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1784045164.162732:0:7496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1784045164.162854:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045164.162862:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:3320:x1870706829703296:12345-0@lo:103: 00010000:00010000:2.0:1784045164.162871:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045164.162877:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 17 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.162886:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 17 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.162896:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2cb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb70 expref: 17 pid: 5796 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.162905:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045164.162941:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3320:x1870706829703296:12345-0@lo:103: Request processed in 81us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.162948:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045164.162963:0:7496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1784045164.162969:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045164.162975:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:3320:x1870706829703424:12345-0@lo:103: 00010000:00010000:2.0:1784045164.162983:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045164.162988:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 15 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.162996:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 15 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163006:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cb5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb54 expref: 15 pid: 5797 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163019:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163034:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163049:0:7496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163057:0:7496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163065:0:7496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163071:0:7496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163078:0:7496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045164.163082:0:7496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163092:0:7496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163108:0:7496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.163119:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045164.163144:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:3320:x1870706829703424:12345-0@lo:103: Request processed in 169us (2799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.163150:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045164.166938:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829703424:0@lo:103: 00000100:00100000:2.0:1784045164.166977:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829703296:0@lo:103: 00000100:00100000:1.0:1784045164.173114:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:3319:x1870706829703680:12345-0@lo:103: Request processed in 10894us (13549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.173132:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1784045164.173195:0:5796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.173209:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.173217:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cbb6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045164.173239:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784045164.179552:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3319:x1870706829703552:12345-0@lo:103: Request processed in 17073us (19928us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.179568:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045164.189230:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829703552:0@lo:103: 00000100:00100000:0.0:1784045164.206222:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829703168:0@lo:103: 00000100:00100000:0.0:1784045164.206240:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829703680:0@lo:103: 00000100:00100000:3.0:1784045164.298763:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:7491:x1870706829702400:12345-0@lo:253: Request processed in 165301us (165750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.298778:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784045164.299004:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829702400:0@lo:253: 10000000:01000000:3.0:1784045164.299033:0:7491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784045164.299036:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045164.299038:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045164.299039:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045164.299040:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784045164.299041:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045164.299043:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045164.299044:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045164.299046:0:7491:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784045164.299047:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045164.299049:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784045164.299145:0:7491:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa93f779800 from lustre-OST0001 10000000:01000000:3.0:1784045164.299170:0:7491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784045164.299173:0:7491:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784045164.299181:0:7491:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa907f44d40 local copy 10000000:01000000:3.0:1784045164.299185:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784045164.299222:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.299233:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.299242:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.299258:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829703808:0@lo:101: 00000100:00100000:3.0:1784045164.299290:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.299322:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045164.301232:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703808 00000100:00100000:2.0:1784045164.301245:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703808 00000100:00100000:2.0:1784045164.301317:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784045164.301327:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:7491:x1870706829703808:12345-0@lo:101: 00010000:00010000:2.0:1784045164.301345:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045164.301364:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2cbc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cbbd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.301394:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2cbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbbd expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.301406:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2cbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbbd expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.301415:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721c00, rc 0) 00000100:00100000:2.0:1784045164.301500:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829703808:12345-0@lo:101: Request processed in 175us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.301507:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784045164.306411:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829703808:0@lo:101: 00010000:00010000:3.0:1784045164.306443:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.306481:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.306629:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829703936:0@lo:501: 00000100:00100000:3.0:1784045164.306769:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.306822:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045164.307871:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829703936 00000100:00100000:0.0:1784045164.307882:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829703936 00000100:00100000:0.0:1784045164.308000:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784045164.308023:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829703936:12345-0@lo:501: 00000100:00100000:0.0:1784045164.308282:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829703936:12345-0@lo:501: Request processed in 260us (1513us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045164.308290:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045164.308381:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829703936:0@lo:501: 10000000:01000000:3.0:1784045164.308407:0:7491:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784045164.308441:0:7491:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784045164.308448:0:7491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.308460:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.308467:0:7491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.308495:0:7491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045164.308520:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa93f779800 10000000:01000000:3.0:1784045164.308525:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784045164.308531:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784045164.308534:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045164.308538:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784045164.308541:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784045164.308571:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.308601:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.308611:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.308630:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704064:0@lo:101: 00000100:00100000:3.0:1784045164.314563:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045164.314655:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045164.314675:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.314688:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784045164.314693:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.314724:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045164.314729:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045164.314733:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045164.314770:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.314774:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045164.314808:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.314815:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148f000/0xdb5b5ff6a2d2cbbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdb5b5ff6a2d2cbc4 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.314860:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045164.314862:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045164.314863:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045164.315963:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045164.315987:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045164.316004:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829704192:0@lo:103: 00000100:00100000:3.0:1784045164.316054:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.316087:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704192 00000100:00100000:3.0:1784045164.316094:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704192 00000100:00100000:3.0:1784045164.316147:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045164.316154:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3321:x1870706829704192:12345-0@lo:103: 00010000:00010000:3.0:1784045164.316167:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045164.316186:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2cbc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbbd expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.316206:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045164.316238:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:3321:x1870706829704192:12345-0@lo:103: Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.316243:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045164.316280:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829704192:0@lo:103: 00000100:00100000:2.0:1784045164.318025:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704064 00000100:00100000:2.0:1784045164.318038:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704064 00000100:00100000:2.0:1784045164.318145:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784045164.318164:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+11:7491:x1870706829704064:12345-0@lo:101: 00010000:00010000:2.0:1784045164.318185:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045164.318210:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cbcb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.318243:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.318268:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.318278:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045164.318354:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704064:12345-0@lo:101: Request processed in 200us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.318360:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784045164.318750:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704064:0@lo:101: 00010000:00010000:3.0:1784045164.318782:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.318793:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045164.318999:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704320:0@lo:501: 00000100:00100000:2.0:1784045164.319032:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.319186:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93a1a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045164.319234:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704320 00000100:00100000:3.0:1784045164.319239:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704320 00000100:00100000:3.0:1784045164.319267:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045164.319275:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704320:12345-0@lo:501: 00000100:00100000:3.0:1784045164.319546:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704320:12345-0@lo:501: Request processed in 271us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.319553:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784045164.319647:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704320:0@lo:501: 00000100:00100000:2.0:1784045164.319682:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704448:0@lo:503: 00000100:00100000:2.0:1784045164.319727:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.319752:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93a1a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045164.319787:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704448 00000100:00100000:3.0:1784045164.319793:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704448 00000100:00100000:3.0:1784045164.319813:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784045164.319819:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704448:12345-0@lo:503: 00000100:00100000:2.0:1784045164.320054:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704448:12345-0@lo:503: Request processed in 234us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.320072:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784045164.320787:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704448:0@lo:503: 00000040:00080000:3.0:1784045164.321093:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045164.321171:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704576:0@lo:502: 00000100:00100000:3.0:1784045164.321218:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.321255:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045164.321273:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704576 00000100:00100000:2.0:1784045164.321280:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704576 00000100:00100000:2.0:1784045164.321319:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784045164.321327:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704576:12345-0@lo:502: 00000100:00100000:2.0:1784045164.321701:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704576:12345-0@lo:502: Request processed in 374us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.321709:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784045164.321879:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704576:0@lo:502: 00000040:00080000:2.0:1784045164.322447:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784045164.322646:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1784045164.322679:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1784045164.322721:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1784045164.322756:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1784045164.322793:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1784045164.322855:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937742d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704704:0@lo:502: 00000100:00100000:2.0:1784045164.322914:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.322955:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910152840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045164.323029:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704704 00000100:00100000:0.0:1784045164.323035:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704704 00000100:00100000:0.0:1784045164.323824:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045164.324000:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704704:12345-0@lo:502: 00000100:00100000:0.0:1784045164.324410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704704:12345-0@lo:502: Request processed in 423us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045164.324418:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784045164.324474:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937742d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704704:0@lo:502: 00000040:00080000:3.0:1784045164.324625:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784045164.324640:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784045164.325975:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784045164.325987:0:7499:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784045164.325994:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045164.325996:0:7499:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784045164.326002:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045164.326016:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8aa907fecd40) 00000020:00000080:3.0:1784045164.326039:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784045164.326044:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784045164.326096:0:7499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa93f779800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784045164.326103:0:7499:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045164.326109:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdb5b5ff6a2d2cbe0 00010000:00010000:2.0:1784045164.329396:0:7499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1784045164.329740:0:7499:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1784045164.336788:0:7499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784045164.337969:0:7499:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784045164.345872:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784045164.347809:0:7499:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784045164.350174:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784045164.350186:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045164.350193:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045164.350196:0:7499:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784045164.350200:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045164.350204:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045164.350206:0:7499:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045164.350209:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045164.350211:0:7499:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784045164.350318:0:7499:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045164.350323:0:7499:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045164.350324:0:7499:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045164.350328:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784045164.350468:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1784045164.350501:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784045164.350528:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.350540:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045164.350548:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa93f779800 from 1 10000000:01000000:3.0:1784045164.350551:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045164.350600:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.350609:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045164.350620:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.350643:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704832:0@lo:101: 00000100:00100000:3.0:1784045164.350710:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.352545:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.354541:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704832 00000100:00100000:1.0:1784045164.354554:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704832 00000100:00100000:1.0:1784045164.354619:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784045164.354630:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:7491:x1870706829704832:12345-0@lo:101: 00010000:00010000:1.0:1784045164.354648:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045164.354667:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cbe7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.354697:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.354717:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.354726:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173000, rc 0) 00000100:00100000:1.0:1784045164.354933:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829704832:12345-0@lo:101: Request processed in 304us (4222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.354940:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784045164.355861:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704832:0@lo:101: 00010000:00010000:2.0:1784045164.355890:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.356161:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045164.356288:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704960:0@lo:501: 00000100:00100000:2.0:1784045164.356341:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045164.356457:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829704960 00000100:00100000:0.0:1784045164.356465:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829704960 00000100:00100000:2.0:1784045164.356466:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9106db600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045164.356512:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784045164.356520:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829704960:12345-0@lo:501: 00000100:00100000:0.0:1784045164.356798:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829704960:12345-0@lo:501: Request processed in 277us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045164.356806:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784045164.356854:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829704960:0@lo:501: 00000100:00100000:2.0:1784045164.356888:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705088:0@lo:503: 00000100:00100000:2.0:1784045164.356927:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.356953:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9106db600 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.357491:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705088 00000100:00100000:1.0:1784045164.357498:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705088 00000100:00100000:1.0:1784045164.357523:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045164.357529:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705088:12345-0@lo:503: 00000100:00100000:1.0:1784045164.358562:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705088:12345-0@lo:503: Request processed in 1028us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.358573:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784045164.358788:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705088:0@lo:503: 00000040:00080000:2.0:1784045164.359174:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045164.359264:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705216:0@lo:502: 00000100:00100000:2.0:1784045164.359311:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.359342:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9106db600 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.359902:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705216 00000100:00100000:1.0:1784045164.359909:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705216 00000100:00100000:1.0:1784045164.359960:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045164.359968:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705216:12345-0@lo:502: 00000100:00100000:1.0:1784045164.360185:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705216:12345-0@lo:502: Request processed in 218us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.360194:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784045164.360973:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705216:0@lo:502: 00000040:00080000:2.0:1784045164.361358:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784045164.361416:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784045164.361456:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705344:0@lo:502: 00000100:00100000:2.0:1784045164.361511:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.361541:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9106db600 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.361866:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705344 00000100:00100000:1.0:1784045164.361873:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705344 00000100:00100000:1.0:1784045164.361914:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784045164.361923:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705344:12345-0@lo:502: 00000100:00100000:1.0:1784045164.362114:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705344:12345-0@lo:502: Request processed in 192us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.362129:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784045164.362260:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705344:0@lo:502: 00000040:00080000:2.0:1784045164.362392:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784045164.362403:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784045164.363022:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045164.363032:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045164.363035:0:7503:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784045164.363042:0:7503:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa93f779800 00000020:00000080:0.0:1784045164.363044:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045164.363065:0:7503:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045164.363068:0:7503:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045164.363070:0:7503:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784045164.363073:0:7503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784045164.363269:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784045164.363293:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045164.363317:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.363329:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045164.363382:0:7491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784045164.363385:0:7491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa93f779800 10000000:01000000:1.0:1784045164.363388:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa93f779800 10000000:01000000:1.0:1784045164.363393:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045164.363399:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa93f779800 from 1 10000000:01000000:1.0:1784045164.363401:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045164.363434:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.363443:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.363453:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045164.363472:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705472:0@lo:101: 00000100:00100000:1.0:1784045164.363522:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045164.363561:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045164.364762:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705472 00000100:00100000:0.0:1784045164.364787:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705472 00000100:00100000:0.0:1784045164.364866:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784045164.364877:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829705472:12345-0@lo:101: 00010000:00010000:0.0:1784045164.364895:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045164.364912:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cbf5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.364938:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.364951:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045164.364962:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031400, rc 0) 00000100:00100000:0.0:1784045164.365024:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705472:12345-0@lo:101: Request processed in 149us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045164.365031:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784045164.365043:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705472:0@lo:101: 00010000:00010000:2.0:1784045164.365062:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.365074:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045164.365169:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705600:0@lo:501: 00000100:00100000:2.0:1784045164.365198:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.365239:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9106db600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045164.365243:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705600 00000100:00100000:3.0:1784045164.365248:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705600 00000100:00100000:3.0:1784045164.365283:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784045164.365290:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705600:12345-0@lo:501: 00000100:00100000:3.0:1784045164.366451:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705600:12345-0@lo:501: Request processed in 1086us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.366462:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784045164.367917:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705600:0@lo:501: 00000100:00100000:2.0:1784045164.367974:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705728:0@lo:503: 00000100:00100000:2.0:1784045164.368039:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.368068:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9106db600 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.368142:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705728 00000100:00100000:1.0:1784045164.368148:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705728 00000100:00100000:1.0:1784045164.368207:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784045164.368216:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705728:12345-0@lo:503: 00000100:00100000:1.0:1784045164.368410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705728:12345-0@lo:503: Request processed in 195us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.368417:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784045164.369312:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705728:0@lo:503: 00000040:00080000:3.0:1784045164.369609:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045164.369681:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705856:0@lo:502: 00000100:00100000:3.0:1784045164.369727:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.369756:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.369868:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705856 00000100:00100000:1.0:1784045164.369874:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705856 00000100:00100000:1.0:1784045164.369915:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784045164.369925:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705856:12345-0@lo:502: 00000100:00100000:1.0:1784045164.370144:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705856:12345-0@lo:502: Request processed in 220us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.370152:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784045164.371136:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705856:0@lo:502: 00000040:00080000:3.0:1784045164.371715:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784045164.371784:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784045164.372127:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784045164.372267:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784045164.372312:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784045164.372363:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784045164.372491:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784045164.372528:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784045164.372578:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784045164.372629:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784045164.372667:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784045164.372743:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784045164.372784:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784045164.373140:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784045164.373276:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784045164.374521:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784045164.374606:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784045164.374677:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784045164.374712:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784045164.374740:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784045164.374782:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784045164.374812:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784045164.374878:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784045164.374920:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784045164.374949:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1784045164.374977:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1784045164.375019:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1784045164.375057:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1784045164.375094:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1784045164.375189:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1784045164.375230:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1784045164.375266:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1784045164.375300:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1784045164.375349:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1784045164.379257:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1784045164.380009:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1784045164.380064:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1784045164.380113:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705984:0@lo:502: 00000100:00100000:3.0:1784045164.380688:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.380772:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829705984 00000100:00100000:2.0:1784045164.380780:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829705984 00000100:00100000:2.0:1784045164.380859:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045164.380868:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705984:12345-0@lo:502: 00000100:00100000:2.0:1784045164.381099:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829705984:12345-0@lo:502: Request processed in 231us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.381107:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784045164.381857:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045164.381890:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829705984:0@lo:502: 00000040:00080000:2.0:1784045164.382264:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1784045164.382279:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784045164.390257:0:7504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784045164.390276:0:7504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8aa907e90000) 00000020:00000080:1.0:1784045164.390299:0:7504:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1784045164.390480:0:7504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa93f779800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784045164.390485:0:7504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa93f779800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784045164.390487:0:7504:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa93f779800 3 00010000:00080000:1.0:1784045164.390516:0:7504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa941ceb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784045164.402061:0:7504:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1784045164.402174:0:7504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784045164.402216:0:7504:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784045164.402240:0:7504:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdb5b5ff6a2d2cc0a 00000100:00080000:1.0:1784045164.402253:0:7504:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784045164.402258:0:7504:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8aa941ceb000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1784045164.402299:0:7504:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa90abdce00 x1870706829706112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045164.402330:0:7504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784045164.402548:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829706240:0@lo:400: 00000100:00100000:3.0:1784045164.402635:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045164.402655:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829706112:0@lo:38: 00000100:00100000:3.0:1784045164.402701:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706240 00000100:00100000:0.0:1784045164.402704:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.402711:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706240 00000100:00100000:0.0:1784045164.402754:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829706496:0@lo:400: 00000100:00100000:3.0:1784045164.402777:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706112 00000100:00100000:3.0:1784045164.402782:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706112 00000100:00100000:0.0:1784045164.402787:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045164.402804:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045164.402814:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829706240:12345-0@lo:400: 00000100:00100000:0.0:1784045164.402870:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784045164.402878:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784045164.402894:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706496 00000100:00100000:0.0:1784045164.402898:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706496 00000100:00100000:3.0:1784045164.402914:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829706240:12345-0@lo:400: Request processed in 101us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.402924:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045164.402943:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045164.402948:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045164.402952:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1870706829706112:12345-0@lo:38: 00000100:00100000:0.0:1784045164.402960:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829706496:12345-0@lo:400: 00010000:00080000:3.0:1784045164.402976:0:5806:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000100:00100000:0.0:1784045164.403001:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829706496:12345-0@lo:400: Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045164.403017:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:3.0:1784045164.403022:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb5b5ff6a2d2cc11 00000004:00100000:3.0:1784045164.403041:0:5806:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045164.403044:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045164.403073:0:5806:0:(import.c:65:import_set_state_nolock()) ffff8aa92ceb2000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1784045164.403078:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad880 x1870706829706496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045164.403091:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829706496:0@lo:400: 00000100:00100000:3.0:1784045164.403132:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1870706829706112:12345-0@lo:38: Request processed in 180us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045164.403139:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784045164.403171:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa90abdce00 x1870706829706112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045164.403180:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045164.403187:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00010000:00080000:3.0:1784045164.403190:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad500 x1870706829706240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045164.403195:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784045164.403202:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:3.0:1784045164.403203:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829706240:0@lo:400: 00000100:00080000:0.0:1784045164.403207:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045164.403216:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829706112:0@lo:38: 00000040:00080000:3.0:1784045164.403386:0:7504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1784045164.403529:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1870706829706624:0@lo:901: 00000020:01000000:0.0:1784045164.403557:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:3.0:1784045164.403568:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1784045164.403582:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045164.403606:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045164.403607:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a240 going to sleep for 11 seconds 00010000:00010000:0.0:1784045164.403620:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784045164.403674:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784045164.403677:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045164.403678:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045164.403679:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045164.403680:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045164.403682:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045164.403683:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045164.403689:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045164.403691:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045164.403692:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045164.403694:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045164.403698:0:7491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1784045164.403700:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045164.403701:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045164.403702:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045164.403703:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045164.403704:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045164.403705:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045164.403705:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045164.403706:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045164.403707:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045164.403708:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045164.403709:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045164.403723:0:7491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784045164.403731:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829706752:0@lo:253: 00000100:00100000:0.0:1784045164.403766:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045164.403796:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045164.403920:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706624 00000100:00100000:2.0:1784045164.403926:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706624 00000100:00100000:3.0:1784045164.403932:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706752 00000100:00100000:3.0:1784045164.403938:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706752 00000100:00100000:2.0:1784045164.403970:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045164.403971:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784045164.403990:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7491:x1870706829706752:12345-0@lo:253: 00000100:00100000:2.0:1784045164.403991:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1870706829706624:12345-0@lo:901: 20000000:01000000:3.0:1784045164.404018:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784045164.404034:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784045164.404382:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7506:x1870706829706624:12345-0@lo:901: Request processed in 401us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.404392:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045164.404484:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829706368:0@lo:400: 00000100:00100000:1.0:1784045164.404526:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045164.404638:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784045164.404694:0:7506:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ad500 x1870706829706624/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784045180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045164.404707:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7506:1870706829706624:0@lo:901: 00000100:00100000:2.0:1784045164.405867:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706368 00000100:00100000:2.0:1784045164.405877:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706368 00000100:00100000:2.0:1784045164.405935:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045164.405944:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829706368:12345-0@lo:400: 00000100:00100000:2.0:1784045164.406021:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829706368:12345-0@lo:400: Request processed in 79us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.406029:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1784045164.406105:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784045164.410457:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93a0ae680 x1870706829706368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045164.410490:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829706368:0@lo:400: 20000000:01000000:1.0:1784045164.502211:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784045164.502232:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784045164.502442:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784045164.502447:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784045164.502467:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.502486:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.502495:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.502533:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045164.502546:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 14 pid: 5796 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045164.502561:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1870706829706880:0@lo:104: 00000100:00100000:2.0:1784045164.502631:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045164.502697:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910da8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045164.502862:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829706880 00000100:00100000:1.0:1784045164.502869:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829706880 00000100:00100000:1.0:1784045164.502914:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784045164.502924:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5820:x1870706829706880:12345-0@lo:104: 00010000:00010000:1.0:1784045164.502938:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.502992:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045164.502998:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:5820:x1870706829706880:12345-0@lo:104: Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.503005:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784045164.503027:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045164.503034:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503041:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784045164.503046:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503055:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045164.503062:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045164.503068:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045164.503106:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503113:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045164.503136:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503144:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030a00/0xdb5b5ff6a2d2cb62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb69 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503161:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045164.503163:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045164.503166:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045164.503193:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829707008:0@lo:103: 00000100:00100000:1.0:1784045164.503231:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045164.503281:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707008 00000100:00100000:1.0:1784045164.503286:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707008 00010000:00010000:1.0:1784045164.503305:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 15 pid: 5796 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045164.503330:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784045164.503339:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:3320:x1870706829707008:12345-0@lo:103: 00010000:00010000:1.0:1784045164.503351:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045164.503357:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 15 pid: 5796 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503366:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 15 pid: 5796 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503399:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503413:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045164.503428:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004726918s 00010000:00010000:1.0:1784045164.503433:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503441:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503448:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503454:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503459:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045164.503464:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503472:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503481:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503491:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045164.503530:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:3320:x1870706829707008:12345-0@lo:103: Request processed in 194us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045164.503537:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784045164.503623:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172200/0xdb5b5ff6a2d2cb69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb62 expref: 14 pid: 5796 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045164.503633:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1870706829706880:0@lo:104: 00010000:00010000:1.0:1784045164.503649:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503658:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503663:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045164.503669:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720000/0xdb5b5ff6a2d2cc18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045164.504025:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829707008:0@lo:103: 00000100:00100000:2.0:1784045164.532521:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:7491:x1870706829706752:12345-0@lo:253: Request processed in 128530us (128744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045164.532535:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784045164.536903:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7491:1870706829706752:0@lo:253: 10000000:01000000:0.0:1784045164.536922:0:7491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784045164.536926:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045164.536928:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045164.536929:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045164.536931:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045164.536932:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045164.536933:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045164.536935:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045164.536937:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045164.536938:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045164.536939:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045164.536941:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784045164.536972:0:7491:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784045164.545126:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045164.545310:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045164.545620:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045164.546128:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784045164.546333:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784045164.548568:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784045164.550030:0:7491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1784045164.774491:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784045164.848868:0:7491:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784045164.848877:0:7491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784045164.848915:0:7491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784045164.848988:0:7491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784045164.849005:0:7491:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784045164.849037:0:7491:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1784045165.794059:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045165.985044:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829707136:0@lo:13: 00000100:00100000:2.0:1784045165.985118:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045165.985164:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707136 00000100:00100000:3.0:1784045165.985172:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707136 00000100:00100000:3.0:1784045165.985219:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045165.985228:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829707136:12345-0@lo:13: 00002000:00000024:3.0:1784045165.985266:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045165.985322:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829707136:12345-0@lo:13: Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045165.985329:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784045165.985881:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ae680 x1870706829707136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045165.985900:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829707136:0@lo:13: 00010000:00010000:3.0:1784045166.823162:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045167.841098:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045168.865180:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045169.569568:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829707392:0@lo:400: 00000100:00100000:0.0:1784045169.569642:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045169.569698:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784045169.569705:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829707264:0@lo:400: 00000100:00100000:0.0:1784045169.569735:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045169.569760:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829707776:0@lo:400: 00000100:00100000:0.0:1784045169.569782:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045169.569827:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829707648:0@lo:400: 00000100:00100000:0.0:1784045169.569872:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045169.569893:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045169.569898:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829707520:0@lo:400: 00000100:00100000:0.0:1784045169.569918:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045169.569944:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707392 00000100:00100000:0.0:1784045169.569952:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707392 00000100:00100000:0.0:1784045169.569994:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707776 00000100:00100000:0.0:1784045169.569998:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707776 00000100:00100000:0.0:1784045169.570019:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707520 00000100:00100000:0.0:1784045169.570022:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707520 00000100:00100000:0.0:1784045169.570037:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045169.570045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829707392:12345-0@lo:400: 00000100:00100000:0.0:1784045169.570100:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829707392:12345-0@lo:400: Request processed in 55us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045169.570107:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045169.570124:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045169.570130:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829707776:12345-0@lo:400: 00000100:00100000:0.0:1784045169.570158:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829707776:12345-0@lo:400: Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045169.570176:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045169.570190:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045169.570196:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829707520:12345-0@lo:400: 00000100:00100000:0.0:1784045169.570230:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829707520:12345-0@lo:400: Request processed in 34us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045169.570237:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045169.570255:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707264 00000100:00100000:0.0:1784045169.570258:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707264 00000100:00100000:0.0:1784045169.570282:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784045169.570288:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:3319:x1870706829707264:12345-0@lo:400: 00000100:00100000:0.0:1784045169.570317:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:3319:x1870706829707264:12345-0@lo:400: Request processed in 29us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045169.570323:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784045169.570349:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707648 00000100:00100000:0.0:1784045169.570352:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707648 00000100:00100000:0.0:1784045169.570379:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045169.570385:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829707648:12345-0@lo:400: 00000100:00100000:0.0:1784045169.570415:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829707648:12345-0@lo:400: Request processed in 30us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045169.570422:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784045169.570441:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045169.570446:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784045169.570476:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90360fb80 x1870706829707520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045169.570491:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829707520:0@lo:400: 00010000:00080000:0.0:1784045169.570515:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90360dc00 x1870706829707648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045169.570531:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829707648:0@lo:400: 00000100:00100000:0.0:1784045169.570565:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829707264:0@lo:400: 00010000:00080000:0.0:1784045169.570575:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90360ca80 x1870706829707776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045169.570583:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829707776:0@lo:400: 00010000:00080000:0.0:1784045169.570591:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90360e300 x1870706829707392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045169.570598:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829707392:0@lo:400: 00010000:00010000:1.0:1784045169.889908:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045170.913014:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045171.105925:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045171.105954:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829707904:0@lo:13: 00000100:00100000:2.0:1784045171.106041:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045171.106307:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829707904 00000100:00100000:3.0:1784045171.106315:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829707904 00000100:00100000:3.0:1784045171.106383:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045171.106393:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829707904:12345-0@lo:13: 00002000:00000024:3.0:1784045171.106429:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045171.106486:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829707904:12345-0@lo:13: Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045171.106493:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1784045171.106519:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045171.106549:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ad500 x1870706829707904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045171.106570:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829707904:0@lo:13: 00000001:02000400:0.0:1784045171.612438:0:7848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784045171.938203:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784045172.641373:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784045172.641380:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa907eaf000 from 30 10000000:01000000:2.0:1784045172.641385:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045172.641445:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.641469:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.641481:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045172.641504:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708032:0@lo:101: 00000100:00100000:2.0:1784045172.641569:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045172.641621:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.644890:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708032 00000100:00100000:0.0:1784045172.644904:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708032 00000100:00100000:0.0:1784045172.644974:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784045172.644985:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829708032:12345-0@lo:101: 00010000:00010000:0.0:1784045172.645006:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045172.645128:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cc1f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.645161:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.645173:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.645182:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031e00, rc 0) 00000100:00100000:0.0:1784045172.646369:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829708032:12345-0@lo:101: Request processed in 1379us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.646379:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784045172.654387:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708032:0@lo:101: 00010000:00010000:1.0:1784045172.654422:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.654437:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.654535:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708160:0@lo:501: 00000100:00100000:1.0:1784045172.654596:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.654644:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.655713:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708160 00000100:00100000:0.0:1784045172.655724:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708160 00000100:00100000:0.0:1784045172.655779:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784045172.655789:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829708160:12345-0@lo:501: 00000100:00100000:0.0:1784045172.656434:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829708160:12345-0@lo:501: Request processed in 644us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.656443:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784045172.656601:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708160:0@lo:501: 00000100:00100000:0.0:1784045172.658770:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708288:0@lo:503: 00000100:00100000:0.0:1784045172.658873:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.658916:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91016a900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.658944:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708288 00000100:00100000:0.0:1784045172.658952:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708288 00000100:00100000:0.0:1784045172.658999:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784045172.659007:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829708288:12345-0@lo:503: 00000100:00100000:0.0:1784045172.659857:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829708288:12345-0@lo:503: Request processed in 822us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.659867:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784045172.660455:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708288:0@lo:503: 00000100:00100000:1.0:1784045172.671166:0:7908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7908:1870706829708416:0@lo:502: 00000100:00100000:1.0:1784045172.671729:0:7908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.671777:0:7908:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa8029713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.671979:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708416 00000100:00100000:0.0:1784045172.671989:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708416 00000100:00100000:0.0:1784045172.672043:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784045172.672053:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7908:x1870706829708416:12345-0@lo:502: 00000100:00100000:0.0:1784045172.680259:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7908:x1870706829708416:12345-0@lo:502: Request processed in 8197us (8520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.680289:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045172.680506:0:7908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7908:1870706829708416:0@lo:502: 00000100:00100000:1.0:1784045172.680578:0:7908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7908:1870706829708544:0@lo:502: 00000100:00100000:1.0:1784045172.680623:0:7908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.680762:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708544 00000100:00100000:0.0:1784045172.680769:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708544 00000100:00100000:0.0:1784045172.680808:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784045172.680816:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7908:x1870706829708544:12345-0@lo:502: 00000100:00100000:1.0:1784045172.681110:0:7908:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa8029713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.681764:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:7908:x1870706829708544:12345-0@lo:502: Request processed in 946us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.681772:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784045172.682000:0:7908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7908:1870706829708544:0@lo:502: 00000040:00080000:1.0:1784045172.682100:0:7908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784045172.692505:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784045172.692542:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045172.692554:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.692568:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045172.708733:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784045172.708748:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784045172.708752:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784045172.708793:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.708806:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.708817:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045172.708857:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708672:0@lo:101: 00000100:00100000:2.0:1784045172.708925:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045172.708965:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708672 00000100:00100000:2.0:1784045172.708984:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708672 00000100:00100000:2.0:1784045172.709030:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784045172.709038:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829708672:12345-0@lo:101: 00010000:00010000:2.0:1784045172.709052:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045172.709066:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cc2d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.709901:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab786c0 going to sleep for 11 seconds 00010000:00010000:2.0:1784045172.709957:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.709973:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.709984:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720200, rc 0) 00000100:00100000:2.0:1784045172.711524:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829708672:12345-0@lo:101: Request processed in 2480us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045172.711545:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784045172.712693:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708672:0@lo:101: 00010000:00010000:1.0:1784045172.712721:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.712745:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.712816:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708800:0@lo:501: 00000100:00100000:1.0:1784045172.712891:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.712924:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.713004:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708800 00000100:00100000:0.0:1784045172.713010:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708800 00000100:00100000:0.0:1784045172.713048:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045172.713057:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829708800:12345-0@lo:501: 00000100:00100000:0.0:1784045172.713322:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829708800:12345-0@lo:501: Request processed in 265us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.713330:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784045172.713558:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708800:0@lo:501: 00000100:00100000:1.0:1784045172.713589:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708928:0@lo:503: 00000100:00100000:1.0:1784045172.713628:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.713652:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.713694:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829708928 00000100:00100000:0.0:1784045172.713699:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829708928 00000100:00100000:0.0:1784045172.713759:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784045172.713766:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829708928:12345-0@lo:503: 00000100:00100000:0.0:1784045172.714064:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829708928:12345-0@lo:503: Request processed in 298us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.714072:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784045172.714408:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829708928:0@lo:503: 00000100:00100000:0.0:1784045172.714917:0:7913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7913:1870706829709056:0@lo:502: 00000100:00100000:0.0:1784045172.714959:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.714987:0:7913:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.715037:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709056 00000100:00100000:1.0:1784045172.715042:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709056 00000100:00100000:1.0:1784045172.715077:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784045172.715176:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:7913:x1870706829709056:12345-0@lo:502: 00000100:00100000:1.0:1784045172.715454:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:7913:x1870706829709056:12345-0@lo:502: Request processed in 359us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.715462:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784045172.715534:0:7913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7913:1870706829709056:0@lo:502: 00000020:01000000:0.0:1784045172.715556:0:7913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045172.715564:0:7913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045172.715567:0:7913:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784045172.715572:0:7913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045172.715574:0:7913:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784045172.715588:0:7913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7913:1870706829709184:0@lo:502: 00000100:00100000:0.0:1784045172.715618:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.715641:0:7913:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.715679:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709184 00000100:00100000:1.0:1784045172.715684:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709184 00000100:00100000:1.0:1784045172.715712:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784045172.715719:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:7913:x1870706829709184:12345-0@lo:502: 00000100:00100000:1.0:1784045172.715822:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:7913:x1870706829709184:12345-0@lo:502: Request processed in 102us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.715853:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045172.715931:0:7913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7913:1870706829709184:0@lo:502: 00000020:01000000:0.0:1784045172.715948:0:7913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045172.715952:0:7913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045172.715954:0:7913:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784045172.715958:0:7913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1784045172.716169:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1784045172.716186:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784045172.716197:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.716208:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045172.716217:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784045172.716219:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa90538d800 from 30 10000000:01000000:1.0:1784045172.716222:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045172.716331:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.716339:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.716348:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.716362:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709312:0@lo:101: 00000100:00100000:1.0:1784045172.716392:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.716452:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.723382:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709312 00000100:00100000:0.0:1784045172.723395:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709312 00000100:00100000:0.0:1784045172.723733:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045172.723744:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829709312:12345-0@lo:101: 00010000:00010000:0.0:1784045172.723762:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045172.723780:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cc3b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.723818:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.723850:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045172.723859:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030c00, rc 0) 00000100:00100000:0.0:1784045172.723934:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829709312:12345-0@lo:101: Request processed in 193us (7541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.723940:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784045172.725010:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709312:0@lo:101: 00010000:00010000:2.0:1784045172.725037:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045172.725051:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045172.725136:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709440:0@lo:501: 00000100:00100000:2.0:1784045172.725181:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045172.725215:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.727870:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709440 00000100:00100000:0.0:1784045172.727883:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709440 00000100:00100000:0.0:1784045172.727934:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045172.727943:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829709440:12345-0@lo:501: 00000100:00100000:0.0:1784045172.730200:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829709440:12345-0@lo:501: Request processed in 2248us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.730216:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045172.730305:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709440:0@lo:501: 00000100:00100000:0.0:1784045172.730355:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709568:0@lo:503: 00000100:00100000:0.0:1784045172.730411:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.730842:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.730863:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709568 00000100:00100000:0.0:1784045172.730869:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709568 00000100:00100000:0.0:1784045172.730904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045172.730911:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829709568:12345-0@lo:503: 00000100:00100000:0.0:1784045172.731167:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829709568:12345-0@lo:503: Request processed in 254us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.731181:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045172.731223:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709568:0@lo:503: 00000100:00100000:0.0:1784045172.732786:0:7916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7916:1870706829709696:0@lo:502: 00000100:00100000:0.0:1784045172.732869:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.732901:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709696 00000100:00100000:0.0:1784045172.732907:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709696 00000100:00100000:0.0:1784045172.732938:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045172.732946:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:7916:x1870706829709696:12345-0@lo:502: 00000100:00100000:0.0:1784045172.733619:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:7916:x1870706829709696:12345-0@lo:502: Request processed in 672us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.733627:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045172.734435:0:7916:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.734473:0:7916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7916:1870706829709696:0@lo:502: 00000100:00100000:0.0:1784045172.734533:0:7916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7916:1870706829709824:0@lo:502: 00000100:00100000:0.0:1784045172.734575:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045172.734600:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709824 00000100:00100000:0.0:1784045172.734604:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709824 00000100:00100000:0.0:1784045172.734633:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784045172.734639:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:7916:x1870706829709824:12345-0@lo:502: 00000100:00100000:0.0:1784045172.735200:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:7916:x1870706829709824:12345-0@lo:502: Request processed in 560us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045172.735209:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784045172.735413:0:7916:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa907e9bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.735431:0:7916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7916:1870706829709824:0@lo:502: 00000040:00080000:0.0:1784045172.735472:0:7916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784045172.735588:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784045172.735609:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784045172.735621:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.735633:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045172.735666:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784045172.735669:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa90538d800 from 5 10000000:01000000:1.0:1784045172.735671:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045172.735701:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.735709:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.735719:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.735732:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709952:0@lo:101: 00000100:00100000:1.0:1784045172.735761:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.735782:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.735797:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829709952 00000100:00100000:1.0:1784045172.735801:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829709952 00000100:00100000:1.0:1784045172.735854:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784045172.735862:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829709952:12345-0@lo:101: 00010000:00010000:1.0:1784045172.735872:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045172.735886:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2cc50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cc49 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.735908:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2cc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc49 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.735920:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2cc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc49 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.735937:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172c00, rc 0) 00000100:00100000:1.0:1784045172.735966:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829709952:12345-0@lo:101: Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.735971:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784045172.736001:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829709952:0@lo:101: 00010000:00010000:1.0:1784045172.736012:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736021:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.736066:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710080:0@lo:256: 00000100:00100000:1.0:1784045172.736095:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.736111:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.736124:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710080 00000100:00100000:1.0:1784045172.736127:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710080 00000100:00100000:1.0:1784045172.736147:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784045172.736153:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829710080:12345-0@lo:256: 20000000:01000000:1.0:1784045172.736165:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784045172.736180:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784045172.736183:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1784045172.736536:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829710080:12345-0@lo:256: Request processed in 381us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.736544:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784045172.736576:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710080:0@lo:256: 10000000:01000000:1.0:1784045172.736617:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784045172.736627:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736636:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045172.736656:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784045172.736658:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1784045172.736661:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784045172.736676:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736684:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736691:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.736703:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710208:0@lo:101: 00000100:00100000:1.0:1784045172.736729:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.736742:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345da240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.736755:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710208 00000100:00100000:1.0:1784045172.736758:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710208 00000100:00100000:1.0:1784045172.736778:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784045172.736784:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829710208:12345-0@lo:101: 00010000:00010000:1.0:1784045172.736791:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045172.736800:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cc57 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736814:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736851:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736859:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172e00, rc 0) 00000100:00100000:1.0:1784045172.736887:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829710208:12345-0@lo:101: Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.736893:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784045172.736920:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710208:0@lo:101: 00010000:00010000:1.0:1784045172.736931:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.736939:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.736975:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710336:0@lo:501: 00000100:00100000:1.0:1784045172.736997:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.737007:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345da240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.737018:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710336 00000100:00100000:1.0:1784045172.737022:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710336 00000100:00100000:1.0:1784045172.737041:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784045172.737047:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829710336:12345-0@lo:501: 00000100:00100000:1.0:1784045172.737519:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829710336:12345-0@lo:501: Request processed in 471us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.737527:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784045172.737559:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710336:0@lo:501: 00000100:00100000:1.0:1784045172.737587:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710464:0@lo:503: 00000100:00100000:1.0:1784045172.737625:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.737637:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345da240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.737714:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710464 00000100:00100000:1.0:1784045172.737718:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710464 00000100:00100000:1.0:1784045172.737739:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784045172.737745:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829710464:12345-0@lo:503: 00000100:00100000:1.0:1784045172.738037:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829710464:12345-0@lo:503: Request processed in 290us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.738044:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784045172.738081:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829710464:0@lo:503: 00000100:00100000:0.0:1784045172.749985:0:7917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7917:1870706829710592:0@lo:502: 00000100:00100000:0.0:1784045172.750067:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.750414:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710592 00000100:00100000:1.0:1784045172.750421:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710592 00000100:00100000:1.0:1784045172.750475:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784045172.750484:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:7917:x1870706829710592:12345-0@lo:502: 00000100:00100000:1.0:1784045172.753478:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:7917:x1870706829710592:12345-0@lo:502: Request processed in 2987us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.753493:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784045172.759343:0:7917:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.759387:0:7917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7917:1870706829710592:0@lo:502: 00000020:01000000:0.0:1784045172.759424:0:7917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784045172.759432:0:7917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784045172.759439:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045172.759441:0:7917:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784045172.759460:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784045172.759463:0:7917:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:0.0:1784045172.759487:0:7917:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784045172.759490:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045172.759517:0:7917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8aa9060c19c0) 00000020:00000080:0.0:1784045172.759539:0:7917:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784045172.759546:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784045172.759643:0:7917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784045172.761189:0:7917:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784045172.761200:0:7917:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2cc6c 00010000:00080000:0.0:1784045172.761733:0:7917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa93f756800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1784045172.761980:0:7917:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1784045172.763574:0:7917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784045172.763589:0:7917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784045172.766733:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045172.767072:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045172.767142:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784045172.767199:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1784045172.782428:0:7920:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045172.782438:0:7920:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1784045172.792368:0:7917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784045172.792383:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784045172.792422:0:7917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1784045172.792455:0:7917:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2cc73 00000100:00080000:1.0:1784045172.792467:0:7917:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784045172.792474:0:7917:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa93f756800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1784045172.792514:0:7917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa90abdf800 x1870706829710720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045172.792539:0:7917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1784045172.792595:0:7917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045172.792607:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045172.792609:0:7917:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1784045172.792613:0:7917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045172.792617:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045172.792619:0:7917:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784045172.792622:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784045172.792623:0:7917:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784045172.793342:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829710976:0@lo:400: 00000100:00100000:3.0:1784045172.793405:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045172.793439:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045172.793457:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829711104:0@lo:400: 00000100:00100000:3.0:1784045172.793479:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045172.793508:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829711232:0@lo:400: 00000100:00100000:3.0:1784045172.793532:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045172.793548:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045172.793554:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829711360:0@lo:400: 00000100:00100000:3.0:1784045172.793574:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045172.793598:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710976 00000100:00100000:3.0:1784045172.793604:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710976 00000100:00100000:3.0:1784045172.793641:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711104 00000100:00100000:3.0:1784045172.794157:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711104 00000100:00100000:2.0:1784045172.794189:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711360 00000100:00100000:3.0:1784045172.794192:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045172.794193:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711360 00000100:00100000:3.0:1784045172.794201:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829710976:12345-0@lo:400: 00000100:00100000:2.0:1784045172.794212:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045172.794219:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829711104:12345-0@lo:400: 00000100:00100000:1.0:1784045172.794341:0:7917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7917:1870706829710848:0@lo:502: 00000100:00100000:1.0:1784045172.796571:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.796613:0:7917:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937db4180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.796636:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829710720:0@lo:8: 00000100:00100000:1.0:1784045172.796688:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784045172.796730:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045172.796744:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710848 00000100:00100000:1.0:1784045172.796750:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710848 00000100:00100000:1.0:1784045172.796789:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784045172.796797:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:7917:x1870706829710848:12345-0@lo:502: 00000100:00100000:1.0:1784045172.797065:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:7917:x1870706829710848:12345-0@lo:502: Request processed in 266us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.797073:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784045172.797250:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711232 00000100:00100000:1.0:1784045172.797254:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711232 00000100:00100000:1.0:1784045172.797279:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829710720 00000100:00100000:1.0:1784045172.797282:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829710720 00000100:00100000:1.0:1784045172.797293:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045172.797299:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829711232:12345-0@lo:400: 00000100:00100000:1.0:1784045172.797340:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829711232:12345-0@lo:400: Request processed in 40us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.797347:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045172.797366:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045172.797371:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1870706829710720:12345-0@lo:8: 00010000:00080000:1.0:1784045172.797392:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1784045172.797419:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2cc7a 00002000:00100000:1.0:1784045172.797433:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8aa937e2a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784045172.797438:0:6599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1784045172.797441:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784045172.797557:0:6599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784045172.797719:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784045172.797742:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa937e2d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045172.797783:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1870706829710720:12345-0@lo:8: Request processed in 410us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.797790:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784045172.797852:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdf800 x1870706829710720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045172.797863:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045172.797871:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784045172.797878:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784045172.797883:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1784045172.797885:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f756800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784045172.797893:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784045172.797898:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829710720:0@lo:8: 00010000:00080000:1.0:1784045172.797932:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0af480 x1870706829711232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045172.797943:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829711232:0@lo:400: 00000100:00100000:1.0:1784045172.797964:0:7917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:7917:1870706829710848:0@lo:502: 00000020:01000000:1.0:1784045172.798295:0:7917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045172.798303:0:7917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045172.798305:0:7917:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784045172.798310:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1784045172.798430:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784045172.798461:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784045172.798471:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.798480:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045172.798490:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784045172.798493:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa907f44d40 from 1 10000000:01000000:1.0:1784045172.798496:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784045172.798529:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.798536:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.798544:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.798560:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829711488:0@lo:101: 00000100:00100000:1.0:1784045172.798595:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.798613:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937db4180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.798631:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711488 00000100:00100000:1.0:1784045172.798635:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711488 00000004:00080000:0.0:1784045172.798860:0:7920:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784045172.798974:0:7920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207485142978ns, next at 0ns, rc = 0 00000100:00100000:1.0:1784045172.799195:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784045172.799211:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829711488:12345-0@lo:101: 00010000:00010000:1.0:1784045172.799222:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045172.799235:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cc81 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.799324:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.799335:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.799344:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173200, rc 0) 00000100:00100000:1.0:1784045172.799382:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829711488:12345-0@lo:101: Request processed in 172us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.799389:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784045172.799427:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829711488:0@lo:101: 00010000:00010000:1.0:1784045172.799442:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.799465:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045172.799511:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829711616:0@lo:501: 00000100:00100000:1.0:1784045172.799535:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.799548:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937db4180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.799561:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711616 00000100:00100000:1.0:1784045172.799564:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711616 00000100:00100000:1.0:1784045172.799584:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784045172.799590:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829711616:12345-0@lo:501: 00000100:00100000:2.0:1784045172.800146:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829711104:12345-0@lo:400: Request processed in 5925us (6664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045172.800156:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045172.800176:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784045172.800185:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829711360:12345-0@lo:400: 00000100:00100000:2.0:1784045172.800226:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829711360:12345-0@lo:400: Request processed in 43us (6651us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045172.800231:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045172.800376:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829711616:12345-0@lo:501: Request processed in 784us (839us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045172.800382:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784045172.800416:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829711616:0@lo:501: 10000000:01000000:1.0:1784045172.800438:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784045172.800456:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045172.800464:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784045172.800608:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ae680 x1870706829711360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045172.800619:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829711360:0@lo:400: 00010000:00080000:2.0:1784045172.800654:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0af100 x1870706829711104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045172.800663:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829711104:0@lo:400: 00000100:00100000:3.0:1784045172.801773:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829710976:12345-0@lo:400: Request processed in 7567us (8362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045172.801785:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1784045172.802192:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ad500 x1870706829710976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045172.802206:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829710976:0@lo:400: 00000004:00080000:1.0:1784045172.850515:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784045172.850605:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829711744:0@lo:13: 00000100:00100000:1.0:1784045172.850689:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045172.850749:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711744 00000100:00100000:1.0:1784045172.850756:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711744 00000100:00100000:1.0:1784045172.850810:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045172.850818:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829711744:12345-0@lo:13: 00002000:00000024:1.0:1784045172.850869:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784045172.850913:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829711744:12345-0@lo:13: Request processed in 95us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045172.850920:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784045172.850943:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784045172.850970:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abded80 x1870706829711744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045172.850988:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829711744:0@lo:13: 00000004:00080000:1.0:1784045172.851015:0:7922:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784045172.851035:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829711872:0@lo:7: 00000100:00100000:1.0:1784045172.851063:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045172.851976:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937db4180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045172.852323:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829711872 00000100:00100000:1.0:1784045172.852328:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829711872 00000100:00100000:1.0:1784045172.852409:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045172.852419:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7922:x1870706829711872:12345-0@lo:7: 00002000:00080000:2.0:1784045172.872477:0:6599:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1784045172.872486:0:6599:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784045172.873258:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7922:x1870706829711872:12345-0@lo:7: Request processed in 20836us (22189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045172.873270:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784045172.875457:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abded80 x1870706829711872/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045188 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045172.875476:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829711872:0@lo:7: 00000004:00080000:0.0:1784045172.875491:0:7922:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784045172.875586:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829712000:0@lo:5: 00000100:00100000:2.0:1784045172.875655:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045172.875697:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045172.875799:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712000 00000100:00100000:0.0:1784045172.875806:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712000 00000100:00100000:0.0:1784045172.875882:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045172.875892:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7922:x1870706829712000:12345-0@lo:5: 00002000:00080000:0.0:1784045172.875920:0:6598:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784045172.875924:0:6598:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784045172.876439:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7922:x1870706829712000:12345-0@lo:5: Request processed in 547us (793us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784045172.876459:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784045172.876542:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0ad80 x1870706829712000/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045188 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045172.876556:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829712000:0@lo:5: 00000004:00080000:2.0:1784045172.876565:0:7922:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784045172.876590:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829712128:0@lo:700: 00000100:00100000:2.0:1784045172.876615:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045172.876640:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045172.876726:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712128 00000100:00100000:3.0:1784045172.876731:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712128 00000100:00100000:3.0:1784045172.876776:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045172.876783:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7922:x1870706829712128:12345-0@lo:700: 00000100:00100000:3.0:1784045172.876820:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6606:1870706829712256:0@lo:700: 00000100:00100000:3.0:1784045172.876868:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045172.876887:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9303a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045172.876943:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712256 00000100:00100000:2.0:1784045172.876947:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712256 00000100:00100000:2.0:1784045172.876984:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045172.876992:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6606:x1870706829712256:12345-0@lo:700: 40000000:02000000:3.0:1784045172.923107:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1784045172.928805:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6606:x1870706829712256:12345-0@lo:700: Request processed in 51801us (51924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045172.928821:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784045172.929130:0:6606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ac000 x1870706829712256/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784045188 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045172.929148:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6606:1870706829712256:0@lo:700: 40000000:02000000:3.0:1784045172.929162:0:6606:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1784045172.961174:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784045172.995078:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1784045172.995107:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784045172.995322:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7922:x1870706829712128:12345-0@lo:700: Request processed in 118534us (118701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045172.995336:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784045172.995511:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08000 x1870706829712128/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784045188 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045172.995524:0:7922:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1784045172.995542:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829712128:0@lo:700: 00000004:02000040:3.0:1784045173.036136:0:7922:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1784045173.041595:0:7922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829712384:0@lo:5: 00000100:00100000:3.0:1784045173.041666:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045173.041769:0:7922:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045173.042664:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712384 00000100:00100000:2.0:1784045173.042673:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712384 00000100:00100000:3.0:1784045173.042861:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045173.042871:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7922:x1870706829712384:12345-0@lo:5: 00002000:00080000:3.0:1784045173.062399:0:6599:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784045173.062423:0:6599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784045173.069182:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7922:x1870706829712384:12345-0@lo:5: Request processed in 26306us (27509us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784045173.069195:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1784045173.071379:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ac000 x1870706829712384/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045189 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045173.071399:0:7922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1870706829712384:0@lo:5: 00000004:00080000:0.0:1784045173.071414:0:7922:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1784045173.990751:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045175.009360:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045176.034264:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045176.225937:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829712512:0@lo:13: 00000100:00100000:1.0:1784045176.226029:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045176.226120:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712512 00000100:00100000:1.0:1784045176.226129:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712512 00000100:00100000:1.0:1784045176.226302:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045176.226315:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829712512:12345-0@lo:13: 00002000:00000024:1.0:1784045176.226365:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045176.226426:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829712512:12345-0@lo:13: Request processed in 113us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045176.226435:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784045176.226461:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045176.226499:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abde680 x1870706829712512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045176.226519:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829712512:0@lo:13: 00000001:00080000:3.0:1784045176.745914:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1784045177.057293:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045177.258393:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045177.258468:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808717440 00000100:00100000:2.0:1784045177.258479:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808717440 00000100:00100000:2.0:1784045177.258519:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:2.0:1784045177.258526:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1870706808717440:12345-192.168.201.58@tcp:250: 00010000:00080000:2.0:1784045177.258550:0:5797:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a6b5546e-953c-4b15-ba5e-c489141abaa9@192.168.201.58@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1784045177.258570:0:5797:0:(genops.c:1406:class_connect()) connect: client a6b5546e-953c-4b15-ba5e-c489141abaa9, cookie 0xdb5b5ff6a2d2cc8f 00000100:00080000:2.0:1784045177.258698:0:5797:0:(import.c:65:import_set_state_nolock()) ffff8aa93f77f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045177.258768:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+5:2359:x1870706808717440:12345-192.168.201.58@tcp:250: Request processed in 241us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045177.258777:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:2.0:1784045177.275911:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045177.275948:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808717568 00000100:00100000:2.0:1784045177.275957:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808717568 00000100:00100000:2.0:1784045177.276007:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:2.0:1784045177.276017:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+5:5565:x1870706808717568:12345-192.168.201.58@tcp:101: 00010000:00010000:2.0:1784045177.276036:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045177.276065:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc19 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045177.276097:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045177.276110:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045177.276123:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720c00, rc 0) 00000100:00100000:2.0:1784045177.276197:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+6:5565:x1870706808717568:12345-192.168.201.58@tcp:101: Request processed in 180us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045177.276204:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:2.0:1784045177.284639:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045177.285066:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808717696 00000100:00100000:1.0:1784045177.285077:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808717696 00000100:00100000:1.0:1784045177.285141:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:1.0:1784045177.285151:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+6:5565:x1870706808717696:12345-192.168.201.58@tcp:501: 00000100:00100000:1.0:1784045177.285523:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+6:5565:x1870706808717696:12345-192.168.201.58@tcp:501: Request processed in 373us (892us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045177.285532:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:1.0:1784045177.301455:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045177.301542:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808717824 00000100:00100000:2.0:1784045177.301554:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808717824 00000100:00100000:2.0:1784045177.301610:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:2.0:1784045177.301621:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+6:5565:x1870706808717824:12345-192.168.201.58@tcp:101: 00010000:00010000:2.0:1784045177.301640:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045177.301660:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc20 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045177.301690:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045177.301702:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045177.301713:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721e00, rc 0) 00000100:00100000:2.0:1784045177.301907:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+7:5565:x1870706808717824:12345-192.168.201.58@tcp:101: Request processed in 287us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045177.301914:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:3.0:1784045177.307037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045177.307697:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808717952 00000100:00100000:0.0:1784045177.307708:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808717952 00000100:00100000:0.0:1784045177.307870:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:0.0:1784045177.307881:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+7:5565:x1870706808717952:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1784045177.308116:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5565:x1870706808717952:12345-192.168.201.58@tcp:501: Request processed in 235us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045177.308131:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:2.0:1784045177.316860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045177.316988:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718080 00000100:00100000:1.0:1784045177.316998:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718080 00000100:00100000:1.0:1784045177.317054:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1784045177.317065:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5565:x1870706808718080:12345-192.168.201.58@tcp:503: 00000100:00100000:1.0:1784045177.317386:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5565:x1870706808718080:12345-192.168.201.58@tcp:503: Request processed in 321us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045177.317394:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1784045177.323156:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045177.323275:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718208 00000100:00100000:3.0:1784045177.323285:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718208 00000100:00100000:3.0:1784045177.323340:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:3.0:1784045177.323350:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5584:x1870706808718208:12345-192.168.201.58@tcp:502: 00000100:00100000:3.0:1784045177.323674:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5584:x1870706808718208:12345-192.168.201.58@tcp:502: Request processed in 324us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045177.323683:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:3.0:1784045177.379041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045177.379387:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718336 00000100:00100000:0.0:1784045177.379398:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718336 00000100:00100000:0.0:1784045177.379459:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1784045177.379470:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5584:x1870706808718336:12345-192.168.201.58@tcp:502: 00000100:00100000:0.0:1784045177.379903:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5584:x1870706808718336:12345-192.168.201.58@tcp:502: Request processed in 433us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045177.379912:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:1.0:1784045177.383817:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045177.384023:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718464 00000100:00100000:1.0:1784045177.384033:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718464 00000100:00100000:1.0:1784045177.384135:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:1.0:1784045177.384303:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5565:x1870706808718464:12345-192.168.201.58@tcp:101: 00010000:00010000:1.0:1784045177.384324:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045177.384435:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2cca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc4a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045177.384614:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2cca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc4a expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045177.384714:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2cca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc4a expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045177.384735:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361800, rc 0) 00000100:00100000:1.0:1784045177.384791:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5565:x1870706808718464:12345-192.168.201.58@tcp:101: Request processed in 647us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045177.384798:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:1.0:1784045177.395027:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045177.395135:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718592 00000100:00100000:3.0:1784045177.395147:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718592 00000100:00100000:3.0:1784045177.395211:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:3.0:1784045177.395224:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5565:x1870706808718592:12345-192.168.201.58@tcp:256: 20000000:01000000:3.0:1784045177.395252:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784045177.395270:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784045177.395274:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784045177.395278:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784045177.395280:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1784045177.397485:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5565:x1870706808718592:12345-192.168.201.58@tcp:256: Request processed in 2254us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045177.397499:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:1.0:1784045177.404540:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045177.405692:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718720 00000100:00100000:3.0:1784045177.405705:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718720 00000100:00100000:3.0:1784045177.407200:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:3.0:1784045177.407220:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5565:x1870706808718720:12345-192.168.201.58@tcp:101: 00010000:00010000:3.0:1784045177.407241:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045177.407267:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc51 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045177.407296:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045177.407308:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045177.407318:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148e000, rc 0) 00000100:00100000:3.0:1784045177.407391:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5565:x1870706808718720:12345-192.168.201.58@tcp:101: Request processed in 179us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045177.407397:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:1.0:1784045177.413382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045177.413461:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718848 00000100:00100000:0.0:1784045177.413473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718848 00000100:00100000:0.0:1784045177.413533:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:0.0:1784045177.413544:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5565:x1870706808718848:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1784045177.413853:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5565:x1870706808718848:12345-192.168.201.58@tcp:501: Request processed in 289us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045177.413861:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:3.0:1784045177.415923:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045177.416016:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808718976 00000100:00100000:1.0:1784045177.416026:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808718976 00000100:00100000:1.0:1784045177.416079:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:1.0:1784045177.416089:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5565:x1870706808718976:12345-192.168.201.58@tcp:503: 00000100:00100000:1.0:1784045177.416476:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5565:x1870706808718976:12345-192.168.201.58@tcp:503: Request processed in 388us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045177.416485:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:1.0:1784045177.420257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045177.420790:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719104 00000100:00100000:3.0:1784045177.420802:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719104 00000100:00100000:3.0:1784045177.420960:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:3.0:1784045177.420971:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5589:x1870706808719104:12345-192.168.201.58@tcp:502: 00000100:00100000:3.0:1784045177.421209:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5589:x1870706808719104:12345-192.168.201.58@tcp:502: Request processed in 240us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045177.421218:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:0.0:1784045177.428415:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045177.428545:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719232 00000100:00100000:3.0:1784045177.428557:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719232 00000100:00100000:3.0:1784045177.428620:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1784045177.428633:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5589:x1870706808719232:12345-192.168.201.58@tcp:502: 00000100:00100000:3.0:1784045177.428998:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5589:x1870706808719232:12345-192.168.201.58@tcp:502: Request processed in 366us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045177.429006:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1784045177.438505:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045177.438908:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719360 00000100:00100000:0.0:1784045177.438922:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719360 00000100:00100000:0.0:1784045177.438979:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1784045177.438988:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2359:x1870706808719360:12345-192.168.201.58@tcp:38: 00010000:00080000:0.0:1784045177.439020:0:7507:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1784045177.439067:0:7507:0:(genops.c:1406:class_connect()) connect: client 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1, cookie 0xdb5b5ff6a2d2ccb2 00000004:00100000:0.0:1784045177.439103:0:7507:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1784045177.439110:0:7507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1784045177.459034:0:7507:0:(import.c:65:import_set_state_nolock()) ffff8aa93f753000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045177.459135:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2359:x1870706808719360:12345-192.168.201.58@tcp:38: Request processed in 20144us (20645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045177.459147:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00010000:00010000:3.0:1784045178.083182:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045178.273237:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829712896:0@lo:400: 00000100:00100000:1.0:1784045178.273312:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045178.273387:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045178.273393:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829713024:0@lo:400: 00000100:00100000:1.0:1784045178.273417:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045178.273507:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829712640:0@lo:400: 00000100:00100000:2.0:1784045178.273538:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045178.273575:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829713152:0@lo:400: 00000100:00100000:2.0:1784045178.273595:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045178.273612:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784045178.273617:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829712768:0@lo:400: 00000100:00100000:2.0:1784045178.273637:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045178.273654:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829713280:0@lo:400: 00000100:00100000:2.0:1784045178.273675:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045178.273700:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712896 00000100:00100000:2.0:1784045178.273707:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712896 00000100:00100000:2.0:1784045178.273751:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713152 00000100:00100000:2.0:1784045178.273754:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713152 00000100:00100000:2.0:1784045178.273768:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712768 00000100:00100000:2.0:1784045178.273771:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712768 00000100:00100000:2.0:1784045178.273785:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045178.273793:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829712896:12345-0@lo:400: 00000100:00100000:2.0:1784045178.273868:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829712896:12345-0@lo:400: Request processed in 74us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045178.273875:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045178.273894:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045178.273900:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829713152:12345-0@lo:400: 00000100:00100000:2.0:1784045178.273932:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829713152:12345-0@lo:400: Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045178.273946:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045178.273959:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045178.273967:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829712768:12345-0@lo:400: 00000100:00100000:2.0:1784045178.273997:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829712768:12345-0@lo:400: Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045178.274002:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784045178.274037:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ae680 x1870706829712768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045178.274052:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829712768:0@lo:400: 00010000:00080000:2.0:1784045178.274063:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d052300 x1870706829713152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045178.274070:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829713152:0@lo:400: 00000100:00100000:1.0:1784045178.274314:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829712640 00000100:00100000:1.0:1784045178.274320:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829712640 00000100:00100000:1.0:1784045178.274372:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784045178.274379:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829712640:12345-0@lo:400: 00000100:00100000:1.0:1784045178.274419:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829712640:12345-0@lo:400: Request processed in 41us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045178.274432:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784045178.274464:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713024 00000100:00100000:1.0:1784045178.274468:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713024 00000100:00100000:1.0:1784045178.274489:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713280 00000100:00100000:1.0:1784045178.274492:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713280 00000100:00100000:1.0:1784045178.274507:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045178.274512:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829713024:12345-0@lo:400: 00000100:00100000:1.0:1784045178.274542:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829713024:12345-0@lo:400: Request processed in 30us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045178.274562:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045178.274574:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045178.274580:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829713280:12345-0@lo:400: 00000100:00100000:1.0:1784045178.274607:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829713280:12345-0@lo:400: Request processed in 28us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045178.274613:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784045178.274628:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045178.274631:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045178.274634:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045178.274645:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829713408:0@lo:13: 00000100:00100000:1.0:1784045178.274671:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784045178.274696:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d050380 x1870706829713024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045178.274706:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829713024:0@lo:400: 00010000:00080000:1.0:1784045178.274717:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0af480 x1870706829712896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045178.274725:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829712896:0@lo:400: 00000100:00100000:1.0:1784045178.274755:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713408 00000100:00100000:1.0:1784045178.274760:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713408 00000100:00100000:1.0:1784045178.274784:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045178.274790:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829713408:12345-0@lo:13: 00002000:00000024:1.0:1784045178.274815:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045178.274881:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829713408:12345-0@lo:13: Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045178.274887:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784045178.274916:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d051500 x1870706829713280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045178.274923:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784045178.274934:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829713280:0@lo:400: 00000100:00100000:1.0:1784045178.274943:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829712640:0@lo:400: 00010000:00080000:1.0:1784045178.274964:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d053480 x1870706829713408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045178.274976:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829713408:0@lo:13: 00000100:00100000:0.0:1784045178.479235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045178.479326:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719488 00000100:00100000:3.0:1784045178.479337:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719488 00000100:00100000:3.0:1784045178.479420:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1784045178.479429:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:0:x1870706808719488:12345-192.168.201.58@tcp:41: 00000004:00000024:3.0:1784045178.479477:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784045178.479532:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:0:x1870706808719488:12345-192.168.201.58@tcp:41: Request processed in 105us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045178.479537:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00080000:1.0:1784045178.479770:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045178.480176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045178.480252:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719616 00000100:00100000:0.0:1784045178.480257:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719616 00000100:00100000:0.0:1784045178.480292:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784045178.480298:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5565:x1870706808719616:12345-192.168.201.58@tcp:41: 00000004:00000024:0.0:1784045178.480311:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784045178.480357:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5565:x1870706808719616:12345-192.168.201.58@tcp:41: Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045178.480364:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:3.0:1784045178.486962:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045178.492414:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719744 00000100:00100000:2.0:1784045178.492432:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719744 00000100:00100000:2.0:1784045178.492519:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045178.492530:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5565:x1870706808719744:12345-192.168.201.58@tcp:40: 00000100:00100000:2.0:1784045178.493644:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5565:x1870706808719744:12345-192.168.201.58@tcp:40: Request processed in 1110us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045178.493657:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784045178.504644:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045178.504701:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045178.504741:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045178.504939:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045178.505089:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720128 00000100:00100000:3.0:1784045178.505099:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720128 00000100:00100000:3.0:1784045178.505162:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784045178.505173:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5565:x1870706808720128:12345-192.168.201.58@tcp:33: 00000100:00100000:3.0:1784045178.505259:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720256 00000100:00100000:3.0:1784045178.505263:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720256 00000100:00100000:3.0:1784045178.505286:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:3.0:1784045178.505293:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808720256:12345-192.168.201.58@tcp:400: 00000100:00100000:3.0:1784045178.505368:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808720256:12345-192.168.201.58@tcp:400: Request processed in 74us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045178.505376:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:0.0:1784045178.511954:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808719872 00000100:00100000:0.0:1784045178.511970:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808719872 00000100:00100000:0.0:1784045178.512029:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720000 00000100:00100000:0.0:1784045178.512033:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720000 00000100:00100000:0.0:1784045178.512051:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784045178.512060:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808719872:12345-192.168.201.58@tcp:8: 00010000:00080000:0.0:1784045178.512092:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1784045178.512122:0:6599:0:(genops.c:1406:class_connect()) connect: client 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1, cookie 0xdb5b5ff6a2d2ccb9 00002000:00100000:0.0:1784045178.512146:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1/ffff8aa93f750000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045178.512173:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784045178.512984:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784045178.513020:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa93f752000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045178.513093:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2359:x1870706808719872:12345-192.168.201.58@tcp:8: Request processed in 1033us (8391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045178.513118:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784045178.514025:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1784045178.514037:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808720000:12345-192.168.201.58@tcp:8: 00010000:00080000:0.0:1784045178.514066:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1784045178.514094:0:6599:0:(genops.c:1406:class_connect()) connect: client 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1, cookie 0xdb5b5ff6a2d2ccc0 00002000:00100000:0.0:1784045178.514107:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1/ffff8aa93f757800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045178.514120:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784045178.515142:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045178.515179:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa93f753800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045178.515293:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2359:x1870706808720000:12345-192.168.201.58@tcp:8: Request processed in 1256us (10550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045178.515303:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000004:00080000:1.0:1784045178.532447:0:5807:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27205us 00000004:00200000:0.0:1784045178.584544:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784045178.585167:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5565:x1870706808720128:12345-192.168.201.58@tcp:33: Request processed in 79986us (80535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045178.585188:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784045178.778800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045178.779034:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720384 00000100:00100000:0.0:1784045178.779048:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720384 00000100:00100000:0.0:1784045178.779263:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784045178.779281:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5606:x1870706808720384:12345-192.168.201.58@tcp:101: 00010000:00010000:0.0:1784045178.779307:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045178.781175:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030e00/0xdb5b5ff6a2d2ccc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045178.781269:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2ccce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045178.781298:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2ccce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045178.781314:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2ccce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045178.781556:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1784045178.781561:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045178.781647:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2ccce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045178.781679:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030e00/0xdb5b5ff6a2d2ccc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc7b expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045178.781699:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2ccce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc7b expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045178.781710:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5800) 00010000:00010000:0.0:1784045178.781713:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045178.781717:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030800, rc 0) 00000100:00100000:0.0:1784045178.782269:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:5606:x1870706808720384:12345-192.168.201.58@tcp:101: Request processed in 2991us (3481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045178.782279:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000001:00100000:0.0:1784045178.909665:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00010000:00010000:3.0:1784045179.105108:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045180.129215:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045181.046528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045181.046629:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720512 00000100:00100000:0.0:1784045181.046642:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720512 00000100:00100000:0.0:1784045181.046737:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1784045181.046751:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:5658:x1870706808720512:12345-192.168.201.58@tcp:41: 00000004:00000024:0.0:1784045181.046940:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784045181.047027:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:5658:x1870706808720512:12345-192.168.201.58@tcp:41: Request processed in 279us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045181.047038:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:1.0:1784045181.047165:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045181.060318:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045181.061767:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720640 00000100:00100000:2.0:1784045181.061781:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720640 00000100:00100000:2.0:1784045181.061934:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1784045181.061946:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:5658:x1870706808720640:12345-192.168.201.58@tcp:13: 00002000:00000024:2.0:1784045181.062000:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045181.062089:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:5658:x1870706808720640:12345-192.168.201.58@tcp:13: Request processed in 138us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045181.062248:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00080000:1.0:1784045181.062496:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045181.075962:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045181.076353:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720768 00000100:00100000:1.0:1784045181.076364:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720768 00000100:00100000:1.0:1784045181.076440:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784045181.076450:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5658:x1870706808720768:12345-192.168.201.58@tcp:13: 00002000:00000024:1.0:1784045181.076489:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045181.076561:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:5658:x1870706808720768:12345-192.168.201.58@tcp:13: Request processed in 112us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045181.076569:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:3.0:1784045181.076966:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784045181.154256:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045181.346783:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045181.346820:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829713536:0@lo:13: 00000100:00100000:3.0:1784045181.346990:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045181.347148:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713536 00000100:00100000:1.0:1784045181.347159:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713536 00000100:00100000:1.0:1784045181.347237:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045181.347249:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829713536:12345-0@lo:13: 00002000:00000024:1.0:1784045181.347306:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045181.347359:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829713536:12345-0@lo:13: Request processed in 112us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045181.347366:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1784045181.347585:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045181.347623:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdc380 x1870706829713536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045181.347646:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829713536:0@lo:13: 00010000:00010000:0.0:1784045182.185426:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784045182.968740:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000001:00100000:0.0:1784045182.983498:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00010000:00010000:3.0:1784045183.201927:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045183.393110:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045183.393134:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829713664:0@lo:13: 00000100:00100000:3.0:1784045183.393199:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045183.393289:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713664 00000100:00100000:3.0:1784045183.393296:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713664 00000100:00100000:3.0:1784045183.393351:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045183.393360:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829713664:12345-0@lo:13: 00002000:00000024:3.0:1784045183.393400:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045183.393444:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829713664:12345-0@lo:13: Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045183.393452:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784045183.393477:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784045183.393516:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d052d80 x1870706829713664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045183.393533:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829713664:0@lo:13: 00000100:00100000:2.0:1784045183.393921:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829714048:0@lo:400: 00000100:00100000:2.0:1784045183.393951:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045183.393972:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045183.393977:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829713920:0@lo:400: 00000100:00100000:2.0:1784045183.393995:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045183.394016:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829714048 00000100:00100000:2.0:1784045183.394019:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829714048 00000100:00100000:0.0:1784045183.394303:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713920 00000100:00100000:0.0:1784045183.394308:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713920 00000100:00100000:0.0:1784045183.394344:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045183.394351:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829714048:12345-0@lo:400: 00000100:00100000:0.0:1784045183.394397:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829714048:12345-0@lo:400: Request processed in 47us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045183.394404:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045183.394417:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045183.394422:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829713920:12345-0@lo:400: 00000100:00100000:0.0:1784045183.394446:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829713920:12345-0@lo:400: Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045183.394451:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045183.394469:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829714176:0@lo:400: 00000100:00100000:0.0:1784045183.394493:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045183.394510:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784045183.394514:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829713792:0@lo:400: 00000100:00100000:0.0:1784045183.394538:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045183.394558:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829714304:0@lo:400: 00000100:00100000:0.0:1784045183.394597:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045183.394622:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829714176 00000100:00100000:0.0:1784045183.394626:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829714176 00000100:00100000:0.0:1784045183.394653:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045183.394660:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829714176:12345-0@lo:400: 00000100:00100000:0.0:1784045183.394692:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829714176:12345-0@lo:400: Request processed in 33us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045183.394698:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045183.394725:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829713920:0@lo:400: 00000100:00100000:0.0:1784045183.394733:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829714048:0@lo:400: 00010000:00080000:0.0:1784045183.394754:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd09180 x1870706829714176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045183.394763:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829714176:0@lo:400: 00000100:00100000:0.0:1784045183.394774:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829714304 00000100:00100000:0.0:1784045183.394776:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829714304 00000100:00100000:0.0:1784045183.394794:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045183.394799:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829714304:12345-0@lo:400: 00000100:00100000:0.0:1784045183.394824:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829714304:12345-0@lo:400: Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045183.394850:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045183.394871:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829714304:0@lo:400: 00000100:00100000:3.0:1784045183.395562:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829713792 00000100:00100000:3.0:1784045183.395567:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829713792 00000100:00100000:3.0:1784045183.395603:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784045183.395610:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829713792:12345-0@lo:400: 00000100:00100000:3.0:1784045183.395666:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829713792:12345-0@lo:400: Request processed in 56us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045183.395673:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1784045183.395699:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045183.395704:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045183.395879:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829713792:0@lo:400: 00000001:02000400:2.0:1784045183.851266:0:8162:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1784045183.912060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045183.912096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045183.914782:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808720896 00000100:00100000:1.0:1784045183.914800:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808720896 00000100:00100000:1.0:1784045183.915392:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:1.0:1784045183.915402:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808720896:12345-192.168.201.58@tcp:400: 00000100:00100000:1.0:1784045183.915482:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808720896:12345-192.168.201.58@tcp:400: Request processed in 81us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045183.915490:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:3.0:1784045183.919356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045183.919415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045183.919505:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721024 00000100:00100000:2.0:1784045183.919515:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721024 00000100:00100000:2.0:1784045183.919577:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1784045183.919665:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808721024:12345-192.168.201.58@tcp:400: 00000100:00100000:2.0:1784045183.919750:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808721024:12345-192.168.201.58@tcp:400: Request processed in 89us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045183.919758:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00080000:2.0:1784045183.919781:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045183.923158:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721152 00000100:00100000:3.0:1784045183.923387:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721280 00000100:00100000:3.0:1784045183.923393:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721280 00000100:00100000:3.0:1784045183.923459:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784045183.923469:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808721280:12345-192.168.201.58@tcp:400: 00000100:00100000:3.0:1784045183.923631:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808721280:12345-192.168.201.58@tcp:400: Request processed in 162us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045183.923640:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00080000:3.0:1784045183.924121:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045183.925288:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721152 00000100:00100000:0.0:1784045183.925369:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1784045183.925378:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808721152:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1784045183.925460:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808721152:12345-192.168.201.58@tcp:400: Request processed in 82us (13362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045183.925468:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:3.0:1784045183.926400:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045184.226051:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045185.251859:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045186.275204:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045186.477509:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829714432:0@lo:13: 00000100:00100000:1.0:1784045186.477583:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045186.485921:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829714432 00000100:00100000:2.0:1784045186.485938:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829714432 00000100:00100000:2.0:1784045186.486006:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045186.486017:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829714432:12345-0@lo:13: 00002000:00000024:2.0:1784045186.486058:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045186.486139:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829714432:12345-0@lo:13: Request processed in 124us (8555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045186.486156:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1784045186.486455:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045186.489249:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0b480 x1870706829714432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045186.489282:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829714432:0@lo:13: 00010000:00010000:3.0:1784045187.299562:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784045187.804016:0:8310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc0d5c080 20000000:00000080:3.0:1784045187.804034:0:8310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa92d3b5000 uarg=0000000000000000 20000000:01000000:3.0:1784045187.804072:0:8310:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1784045187.804074:0:8310:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1784045187.804077:0:8310:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1784045187.804082:0:8310:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1784045187.804087:0:8310:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1784045187.804101:0:8310:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784045187.804117:0:8310:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784045187.804314:0:8310:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1784045187.804316:0:8310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784045187.805244:0:8311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1784045187.808170:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1784045187.808247:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1784045187.808283:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1784045187.808294:0:8310:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784045187.808298:0:8310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784045187.815181:0:8312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1784045187.815813:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1784045187.815895:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1784045187.815951:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1784045187.815964:0:8310:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784045187.815967:0:8310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784045187.817120:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1784045187.817936:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1784045187.818484:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1784045187.818539:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1784045187.818555:0:8310:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784045187.818558:0:8310:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784045187.820738:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1784045187.821319:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1784045187.821370:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1784045187.821409:0:8310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1784045187.821429:0:8310:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784045187.821450:0:8310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821467:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821475:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821483:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821489:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821495:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821515:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821521:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821530:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821537:0:8310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821545:0:8310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821585:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821601:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 9 pid: 5797 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.821615:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714560:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045187.821753:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821762:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 9 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.821771:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714688:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045187.821808:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821816:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 18 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.821825:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714816:0@lo:104: 00000100:00100000:1.0:1784045187.821908:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045187.821944:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.821952:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 18 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.821959:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714944:0@lo:104: 00000100:00100000:1.0:1784045187.821982:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045187.822004:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.822012:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 18 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.822020:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715072:0@lo:104: 00010000:00010000:1.0:1784045187.822043:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.822051:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 18 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.822058:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715200:0@lo:104: 00010000:00010000:1.0:1784045187.822093:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.822101:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 18 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.822109:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715328:0@lo:104: 00010000:00010000:1.0:1784045187.822129:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.822138:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 18 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.822146:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715456:0@lo:104: 00010000:00010000:1.0:1784045187.822167:0:8310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.822175:0:8310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 18 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.822183:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715584:0@lo:104: 00000100:00100000:1.0:1784045187.822217:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9303a3540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045187.822408:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784045187.822428:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.822440:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.822450:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.822470:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.822481:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.822492:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829714816 00000100:00100000:0.0:1784045187.822499:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829714816 00000100:00100000:0.0:1784045187.822531:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829714944 00000100:00100000:0.0:1784045187.822534:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829714944 00000100:00100000:0.0:1784045187.822543:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715072 00000100:00100000:0.0:1784045187.822545:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715072 00000100:00100000:0.0:1784045187.822552:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715200 00000100:00100000:0.0:1784045187.822555:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715200 00000100:00100000:0.0:1784045187.822562:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715328 00000100:00100000:0.0:1784045187.822564:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715328 00000100:00100000:0.0:1784045187.822571:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715456 00000100:00100000:0.0:1784045187.822574:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715456 00000100:00100000:0.0:1784045187.822582:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715584 00000100:00100000:0.0:1784045187.822584:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715584 00000100:00100000:0.0:1784045187.822595:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045187.822603:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:8310:x1870706829714816:12345-0@lo:104: 00010000:00010000:0.0:1784045187.822618:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.822681:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045187.822688:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+9:8310:x1870706829714816:12345-0@lo:104: Request processed in 86us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.822695:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045187.822713:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045187.822719:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+8:8310:x1870706829714944:12345-0@lo:104: 00010000:00010000:0.0:1784045187.822726:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.822762:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784045187.822767:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d24850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+8:8310:x1870706829714944:12345-0@lo:104: Request processed in 50us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.822773:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045187.822800:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045187.822807:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+7:8310:x1870706829715072:12345-0@lo:104: 00010000:00010000:0.0:1784045187.822815:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.822863:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784045187.822868:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+7:8310:x1870706829715072:12345-0@lo:104: Request processed in 63us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.822874:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045187.822886:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045187.822892:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:8310:x1870706829715200:12345-0@lo:104: 00010000:00010000:0.0:1784045187.822900:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.822934:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1784045187.822939:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+6:8310:x1870706829715200:12345-0@lo:104: Request processed in 48us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.822945:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045187.822958:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045187.822964:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:8310:x1870706829715328:12345-0@lo:104: 00010000:00010000:0.0:1784045187.822971:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823010:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1784045187.823015:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:8310:x1870706829715328:12345-0@lo:104: Request processed in 52us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.823020:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045187.823032:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045187.823037:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:8310:x1870706829715456:12345-0@lo:104: 00010000:00010000:0.0:1784045187.823044:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823071:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1784045187.823076:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:8310:x1870706829715456:12345-0@lo:104: Request processed in 40us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.823082:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045187.823093:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045187.823098:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:8310:x1870706829715584:12345-0@lo:104: 00010000:00010000:0.0:1784045187.823105:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823138:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1784045187.823143:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:8310:x1870706829715584:12345-0@lo:104: Request processed in 45us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.823148:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784045187.823171:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1784045187.823178:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823185:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823219:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823229:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823236:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823241:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823276:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823283:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823302:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823308:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942172400/0xdb5b5ff6a2d2cc81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc88 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823331:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784045187.823335:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823340:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823343:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823349:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823355:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823360:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823373:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823378:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823392:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823399:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cc57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc5e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823409:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784045187.823412:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823427:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823430:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823437:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823443:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823448:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823461:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823467:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823472:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823478:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cc3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc42 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823486:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784045187.823489:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823495:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823498:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823515:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823521:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823527:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823540:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823545:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823550:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823557:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2cc2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823567:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784045187.823570:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823575:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823577:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823584:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823589:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823600:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823615:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823620:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823625:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823631:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937721800/0xdb5b5ff6a2d2cc1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cc26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823640:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045187.823643:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823649:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823651:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823658:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823664:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823669:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823680:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823685:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823696:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823702:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cbf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbfc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823711:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045187.823714:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823721:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045187.823724:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823731:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045187.823736:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045187.823742:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045187.823753:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823759:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045187.823763:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823769:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cbcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbd2 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.823780:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045187.823786:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045187.823788:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045187.823796:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045187.823818:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829715712:0@lo:103: 00000100:00100000:0.0:1784045187.823882:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.823916:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829716224:0@lo:103: 00000100:00100000:0.0:1784045187.823937:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.823956:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045187.823962:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829716096:0@lo:103: 00000100:00100000:0.0:1784045187.823980:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.824005:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829715840:0@lo:103: 00000100:00100000:0.0:1784045187.824027:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.824044:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829716352:0@lo:103: 00000100:00100000:0.0:1784045187.824060:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.824078:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784045187.824083:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829715968:0@lo:103: 00000100:00100000:0.0:1784045187.824103:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.824112:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829716480:0@lo:103: 00000100:00100000:0.0:1784045187.824133:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045187.824155:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715712 00000100:00100000:0.0:1784045187.824162:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715712 00010000:00010000:0.0:1784045187.824186:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 19 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824215:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716224 00000100:00100000:0.0:1784045187.824218:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716224 00010000:00010000:0.0:1784045187.824230:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 20 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824252:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716096 00000100:00100000:0.0:1784045187.824254:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716096 00010000:00010000:0.0:1784045187.824264:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 21 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824272:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715840 00000100:00100000:0.0:1784045187.824274:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715840 00010000:00010000:0.0:1784045187.824282:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 22 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824291:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716352 00000100:00100000:0.0:1784045187.824292:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716352 00010000:00010000:0.0:1784045187.824300:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 23 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824310:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829715968 00000100:00100000:0.0:1784045187.824312:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829715968 00010000:00010000:0.0:1784045187.824320:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 24 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824329:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716480 00000100:00100000:0.0:1784045187.824331:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716480 00010000:00010000:0.0:1784045187.824339:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 25 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045187.824351:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045187.824357:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+25:3321:x1870706829715712:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824369:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824374:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 25 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824395:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 25 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824413:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824446:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+25:3321:x1870706829715712:12345-0@lo:103: Request processed in 90us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824453:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045187.824468:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045187.824474:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+24:3321:x1870706829716224:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824482:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824487:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 24 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824494:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 24 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824503:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824524:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+24:3321:x1870706829716224:12345-0@lo:103: Request processed in 51us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824530:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045187.824543:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045187.824549:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+23:3321:x1870706829716096:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824557:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824561:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 23 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824568:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 23 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824583:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824606:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+23:3321:x1870706829716096:12345-0@lo:103: Request processed in 57us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824612:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045187.824624:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045187.824630:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+22:3318:x1870706829715840:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824639:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824643:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 22 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824651:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 22 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824660:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824684:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+22:3318:x1870706829715840:12345-0@lo:103: Request processed in 55us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824690:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045187.824702:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045187.824708:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3318:x1870706829716352:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824715:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824719:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 21 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824727:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 21 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824737:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824763:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3318:x1870706829716352:12345-0@lo:103: Request processed in 56us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824769:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045187.824782:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045187.824787:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3318:x1870706829715968:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824795:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824799:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 20 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824807:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 20 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824817:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824873:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3318:x1870706829715968:12345-0@lo:103: Request processed in 86us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824880:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045187.824892:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045187.824897:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829716480:12345-0@lo:103: 00010000:00010000:0.0:1784045187.824904:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045187.824908:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 19 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824916:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 19 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045187.824925:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045187.824944:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829716480:12345-0@lo:103: Request processed in 47us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.824950:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045187.825028:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829715968:0@lo:103: 00000100:00100000:0.0:1784045187.825037:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829716480:0@lo:103: 00000100:00100000:0.0:1784045187.825044:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829715840:0@lo:103: 00000100:00100000:0.0:1784045187.825050:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829716352:0@lo:103: 00000100:00100000:0.0:1784045187.825080:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829716096:0@lo:103: 00000100:00100000:0.0:1784045187.825088:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829715712:0@lo:103: 00000100:00100000:0.0:1784045187.825094:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829716224:0@lo:103: 00010000:00010000:1.0:1784045187.826133:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cc88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc81 expref: 18 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826148:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714816:0@lo:104: 00010000:00010000:1.0:1784045187.826160:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cc5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc57 expref: 17 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826169:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714944:0@lo:104: 00010000:00010000:1.0:1784045187.826202:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2cc42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc3b expref: 16 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826211:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715072:0@lo:104: 00010000:00010000:1.0:1784045187.826222:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2cc34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc2d expref: 15 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826230:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715200:0@lo:104: 00010000:00010000:1.0:1784045187.826238:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cc26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cc1f expref: 14 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826247:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715328:0@lo:104: 00010000:00010000:1.0:1784045187.826255:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2cbfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbf5 expref: 13 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826264:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715456:0@lo:104: 00010000:00010000:1.0:1784045187.826272:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720a00/0xdb5b5ff6a2d2cbd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbcb expref: 12 pid: 5799 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.826280:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829715584:0@lo:104: 00000100:00100000:2.0:1784045187.831358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045187.831397:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045187.831427:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721408 00000100:00100000:2.0:1784045187.831435:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721408 00010000:00010000:2.0:1784045187.831473:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 10 pid: 5797 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045187.831503:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721536 00000100:00100000:2.0:1784045187.831507:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721536 00010000:00010000:2.0:1784045187.831522:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 11 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045187.831543:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1784045187.831551:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:2360:x1870706808721408:12345-192.168.201.58@tcp:103: 00010000:00010000:2.0:1784045187.831566:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045187.831583:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 11 pid: 5797 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.831596:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 11 pid: 5797 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.831619:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045187.832085:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:2360:x1870706808721408:12345-192.168.201.58@tcp:103: Request processed in 134us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045187.832094:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1784045187.832114:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1784045187.832122:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808721536:12345-192.168.201.58@tcp:103: 00010000:00010000:2.0:1784045187.832143:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045187.832149:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 10 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832159:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 10 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832173:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832182:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832209:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832215:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832222:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832229:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832236:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045187.832241:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832250:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832272:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045187.832282:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045187.832305:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808721536:12345-192.168.201.58@tcp:103: Request processed in 184us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045187.832311:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00010000:00010000:1.0:1784045187.832954:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2cc9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc20 expref: 9 pid: 5797 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.832970:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714560:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045187.832994:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2cc96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc19 expref: 8 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045187.833006:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8310:1870706829714688:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045187.833057:0:8310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.833067:0:8310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.833074:0:8310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045187.833081:0:8310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa92d360600/0xdb5b5ff6a2d2ccd5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045187.955945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045187.956103:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721664 00000100:00100000:3.0:1784045187.956113:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721664 00000100:00100000:3.0:1784045187.956179:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:3.0:1784045187.956201:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:5579:x1870706808721664:12345-192.168.201.58@tcp:101: 00010000:00010000:3.0:1784045187.956219:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045187.956240:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942172800/0xdb5b5ff6a2d2ccdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc82 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045187.956272:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172800/0xdb5b5ff6a2d2ccdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc82 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045187.956285:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942172800/0xdb5b5ff6a2d2ccdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc82 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045187.956293:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172800, rc 0) 00000100:00100000:3.0:1784045187.956354:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808721664:12345-192.168.201.58@tcp:101: Request processed in 167us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045187.956374:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:2.0:1784045187.960495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045187.960694:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721792 00000100:00100000:3.0:1784045187.960705:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721792 00000100:00100000:3.0:1784045187.960774:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:3.0:1784045187.960784:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808721792:12345-192.168.201.58@tcp:501: 00000100:00100000:3.0:1784045187.961119:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808721792:12345-192.168.201.58@tcp:501: Request processed in 336us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045187.961127:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:3.0:1784045187.971373:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045187.971934:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808721920 00000100:00100000:1.0:1784045187.971944:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808721920 00000100:00100000:1.0:1784045187.972005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:1.0:1784045187.972015:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808721920:12345-192.168.201.58@tcp:503: 00000100:00100000:1.0:1784045187.972239:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808721920:12345-192.168.201.58@tcp:503: Request processed in 224us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045187.972247:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:2.0:1784045187.990588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045187.993455:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722048 00000100:00100000:0.0:1784045187.993478:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722048 00000100:00100000:0.0:1784045187.993543:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:0.0:1784045187.993552:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:6046:x1870706808722048:12345-192.168.201.58@tcp:502: 00000100:00100000:0.0:1784045187.995005:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:6046:x1870706808722048:12345-192.168.201.58@tcp:502: Request processed in 1447us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045187.995018:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:3.0:1784045188.021767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045188.026627:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722176 00000100:00100000:1.0:1784045188.026642:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722176 00000100:00100000:1.0:1784045188.026725:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:1.0:1784045188.026736:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:6046:x1870706808722176:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045188.027051:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:6046:x1870706808722176:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 316us (5292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045188.027060:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:2.0:1784045188.048574:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045188.048719:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722304 00000100:00100000:0.0:1784045188.048729:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722304 00000100:00100000:0.0:1784045188.048791:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:0.0:1784045188.048801:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808722304:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045188.048821:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045188.048856:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc89 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045188.048886:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc89 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045188.048906:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc89 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045188.048916:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030600, rc 0) 00000100:00100000:0.0:1784045188.048970:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808722304:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 170us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045188.049313:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:3.0:1784045188.061370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045188.061415:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722432 00000100:00100000:3.0:1784045188.061426:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722432 00000100:00100000:3.0:1784045188.061482:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:3.0:1784045188.061492:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808722432:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045188.061961:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808722432:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 469us (599us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045188.061969:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00010000:00010000:0.0:1784045188.321139:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045188.513853:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829716608:0@lo:13: 00000100:00100000:0.0:1784045188.513935:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045188.514146:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716608 00000100:00100000:2.0:1784045188.514156:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716608 00000100:00100000:2.0:1784045188.514259:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045188.514273:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829716608:12345-0@lo:13: 00002000:00000024:2.0:1784045188.514318:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045188.514372:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829716608:12345-0@lo:13: Request processed in 104us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045188.514379:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784045188.514421:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d051880 x1870706829716608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045188.514440:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829716608:0@lo:13: 00000100:00100000:1.0:1784045188.514645:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829716736:0@lo:400: 00000100:00100000:1.0:1784045188.514699:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045188.514722:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829717248:0@lo:400: 00000100:00100000:1.0:1784045188.514751:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045188.514771:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045188.514776:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829717120:0@lo:400: 00000100:00100000:1.0:1784045188.514800:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045188.514849:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717248 00000100:00100000:1.0:1784045188.514854:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717248 00000100:00100000:1.0:1784045188.514889:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045188.514896:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829717248:12345-0@lo:400: 00000100:00100000:1.0:1784045188.514935:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829717248:12345-0@lo:400: Request processed in 39us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045188.514941:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045188.514960:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717120 00000100:00100000:1.0:1784045188.514964:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717120 00000100:00100000:1.0:1784045188.514991:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045188.514997:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829717120:12345-0@lo:400: 00000100:00100000:1.0:1784045188.515027:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829717120:12345-0@lo:400: Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045188.515033:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1784045188.515065:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d050700 x1870706829717120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045188.515074:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829717120:0@lo:400: 00000100:00100000:1.0:1784045188.515084:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829717248:0@lo:400: 00000100:00080000:0.0:1784045188.515215:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045188.515220:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045188.515222:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045188.515234:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829716864:0@lo:400: 00000100:00100000:0.0:1784045188.515263:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045188.515295:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045188.515302:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829716992:0@lo:400: 00000100:00100000:0.0:1784045188.515322:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045188.515401:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716864 00000100:00100000:3.0:1784045188.515406:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716864 00000100:00100000:3.0:1784045188.515436:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716992 00000100:00100000:3.0:1784045188.515440:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716992 00000100:00100000:3.0:1784045188.515460:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045188.515466:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829716864:12345-0@lo:400: 00000100:00100000:3.0:1784045188.515504:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829716864:12345-0@lo:400: Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045188.515522:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045188.515537:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045188.515542:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829716992:12345-0@lo:400: 00000100:00100000:3.0:1784045188.515574:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829716992:12345-0@lo:400: Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045188.515579:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045188.515648:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829716736 00000100:00100000:2.0:1784045188.515653:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829716736 00000100:00100000:2.0:1784045188.515689:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784045188.515695:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3321:x1870706829716736:12345-0@lo:400: 00000100:00100000:2.0:1784045188.515743:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:3321:x1870706829716736:12345-0@lo:400: Request processed in 48us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045188.515749:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1784045188.515875:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045188.515902:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829716992:0@lo:400: 00000100:00100000:0.0:1784045188.515912:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829716864:0@lo:400: 00000100:00100000:1.0:1784045188.516455:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829716736:0@lo:400: 00000100:00100000:0.0:1784045189.025889:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045189.025988:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045189.026022:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045189.026052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045189.026265:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722688 00000100:00100000:2.0:1784045189.026274:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722688 00000100:00100000:2.0:1784045189.026345:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1784045189.026355:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808722688:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045189.026430:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808722688:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045189.026438:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:1.0:1784045189.026994:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722816 00000100:00100000:1.0:1784045189.027001:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722816 00000100:00100000:1.0:1784045189.027038:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722944 00000100:00100000:1.0:1784045189.027041:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722944 00000100:00100000:1.0:1784045189.027057:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045189.027063:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808722816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045189.027108:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808722816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 44us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045189.027114:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045189.027127:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1784045189.027132:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808722944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045189.027155:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808722944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045189.027160:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00080000:0.0:1784045189.028471:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045189.028478:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045189.028482:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045189.033543:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808722560 00000100:00100000:3.0:1784045189.033556:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808722560 00000100:00100000:3.0:1784045189.033617:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:3.0:1784045189.034455:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808722560:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045189.034551:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808722560:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 925us (8671us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.034560:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00010000:00010000:0.0:1784045189.345252:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784045189.474272:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784045189.474281:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa93f779800 from 39 10000000:01000000:0.0:1784045189.474285:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784045189.474354:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.474366:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.474377:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045189.474403:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829717376:0@lo:101: 00000100:00100000:0.0:1784045189.474477:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.474537:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.474578:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717376 00000100:00100000:0.0:1784045189.474584:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717376 00000100:00100000:0.0:1784045189.474634:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784045189.474642:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+12:5801:x1870706829717376:12345-0@lo:101: 00010000:00010000:0.0:1784045189.474657:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045189.474672:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030a00/0xdb5b5ff6a2d2ccf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ccea expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.474696:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030a00/0xdb5b5ff6a2d2ccf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ccea expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.474707:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030a00/0xdb5b5ff6a2d2ccf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ccea expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.474730:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030a00, rc 0) 00000100:00100000:0.0:1784045189.474771:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829717376:12345-0@lo:101: Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.474778:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784045189.474865:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829717376:0@lo:101: 00010000:00010000:0.0:1784045189.474880:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.474889:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045189.474938:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829717504:0@lo:501: 00000100:00100000:0.0:1784045189.474972:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.474990:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.475004:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717504 00000100:00100000:0.0:1784045189.475007:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717504 00000100:00100000:0.0:1784045189.475031:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784045189.475037:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829717504:12345-0@lo:501: 00000100:00100000:0.0:1784045189.475296:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829717504:12345-0@lo:501: Request processed in 258us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.475304:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784045189.475334:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829717504:0@lo:501: 00000100:00100000:0.0:1784045189.475358:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829717632:0@lo:503: 00000100:00100000:0.0:1784045189.475394:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.475408:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.475427:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717632 00000100:00100000:0.0:1784045189.475430:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717632 00000100:00100000:0.0:1784045189.475452:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784045189.475458:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829717632:12345-0@lo:503: 00000100:00100000:0.0:1784045189.475592:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829717632:12345-0@lo:503: Request processed in 134us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.475599:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784045189.475632:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829717632:0@lo:503: 00000100:00100000:0.0:1784045189.475795:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8329:1870706829717760:0@lo:502: 00000100:00100000:0.0:1784045189.482187:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.482242:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.482516:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717760 00000100:00100000:3.0:1784045189.482525:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717760 00000100:00100000:3.0:1784045189.482579:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784045189.482589:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:8329:x1870706829717760:12345-0@lo:502: 00000100:00100000:3.0:1784045189.482871:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:8329:x1870706829717760:12345-0@lo:502: Request processed in 283us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.482879:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784045189.483134:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8329:1870706829717760:0@lo:502: 00000100:00100000:0.0:1784045189.483544:0:8329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8329:1870706829717888:0@lo:502: 00000100:00100000:0.0:1784045189.483587:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.483613:0:8329:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.483801:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829717888 00000100:00100000:3.0:1784045189.483808:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829717888 00000100:00100000:3.0:1784045189.483867:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784045189.483875:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:8329:x1870706829717888:12345-0@lo:502: 00000100:00100000:3.0:1784045189.484074:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:8329:x1870706829717888:12345-0@lo:502: Request processed in 199us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.484088:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784045189.486819:0:8329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8329:1870706829717888:0@lo:502: 00000040:00080000:1.0:1784045189.486894:0:8329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784045189.487146:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784045189.487178:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045189.487189:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.487199:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045189.487210:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784045189.487212:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1784045189.487215:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784045189.487263:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.487271:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.487280:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045189.487316:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718016:0@lo:101: 00000100:00100000:2.0:1784045189.487373:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.487409:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced9300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.487750:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718016 00000100:00100000:0.0:1784045189.487757:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718016 00000100:00100000:0.0:1784045189.487809:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784045189.487819:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+13:5801:x1870706829718016:12345-0@lo:101: 00010000:00010000:0.0:1784045189.487872:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045189.487887:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2ccff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.487912:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2ccff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ccf8 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.487922:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2ccff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ccf8 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.487939:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031400, rc 0) 00000100:00100000:0.0:1784045189.487993:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829718016:12345-0@lo:101: Request processed in 175us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.487999:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784045189.488283:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718016:0@lo:101: 00010000:00010000:2.0:1784045189.488299:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.488320:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045189.488375:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718144:0@lo:501: 00000100:00100000:2.0:1784045189.488401:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.488418:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced9300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.488684:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718144 00000100:00100000:0.0:1784045189.488688:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718144 00000100:00100000:0.0:1784045189.488719:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784045189.488726:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829718144:12345-0@lo:501: 00000100:00100000:0.0:1784045189.489224:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829718144:12345-0@lo:501: Request processed in 496us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.489231:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784045189.489316:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718144:0@lo:501: 00000100:00100000:1.0:1784045189.489347:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718272:0@lo:503: 00000100:00100000:1.0:1784045189.489383:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045189.489408:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910138600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.489596:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718272 00000100:00100000:0.0:1784045189.489600:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718272 00000100:00100000:0.0:1784045189.489620:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784045189.489626:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829718272:12345-0@lo:503: 00000100:00100000:0.0:1784045189.489771:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829718272:12345-0@lo:503: Request processed in 144us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.489777:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784045189.489898:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718272:0@lo:503: 00000100:00100000:1.0:1784045189.490681:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8330:1870706829718400:0@lo:502: 00000100:00100000:1.0:1784045189.490724:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045189.490753:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910138780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.491215:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718400 00000100:00100000:3.0:1784045189.491223:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718400 00000100:00100000:3.0:1784045189.491290:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784045189.491298:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:8330:x1870706829718400:12345-0@lo:502: 00000100:00100000:3.0:1784045189.491512:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:8330:x1870706829718400:12345-0@lo:502: Request processed in 214us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.491519:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784045189.492573:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8330:1870706829718400:0@lo:502: 00000020:01000000:1.0:1784045189.492610:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045189.492620:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045189.492622:0:8330:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784045189.492628:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784045189.492657:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8330:1870706829718528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045189.492704:0:8330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.496232:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718528 00000100:00100000:2.0:1784045189.496248:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718528 00000100:00100000:2.0:1784045189.496307:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784045189.496318:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:8330:x1870706829718528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045189.496568:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:8330:x1870706829718528:12345-0@lo:502:llog_process_th.0 Request processed in 250us (3862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045189.496576:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045189.502428:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908223000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045189.502478:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8330:1870706829718528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784045189.502520:0:8330:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045189.502530:0:8330:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045189.502532:0:8330:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784045189.502537:0:8330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1784045189.503936:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1784045189.503974:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784045189.503987:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.503999:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045189.504009:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784045189.504012:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa907eaf000 from 39 10000000:01000000:3.0:1784045189.504015:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045189.504053:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.504060:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.504069:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045189.504093:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.504181:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.504216:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930a700c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.504353:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718656 00000100:00100000:0.0:1784045189.504360:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718656 00000100:00100000:0.0:1784045189.504410:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784045189.504419:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:5801:x1870706829718656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045189.504433:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045189.504447:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cd0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd06 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.504482:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd06 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.504492:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd06 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.504501:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031e00, rc 0) 00000100:00100000:0.0:1784045189.504545:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829718656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.504551:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784045189.504595:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045189.504611:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.504620:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045189.504670:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.504694:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.504864:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.504877:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718784 00000100:00100000:0.0:1784045189.504882:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718784 00000100:00100000:0.0:1784045189.504907:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784045189.504913:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829718784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.505182:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829718784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.505198:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784045189.505231:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.505260:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.505297:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.505311:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.505323:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829718912 00000100:00100000:0.0:1784045189.505326:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829718912 00000100:00100000:0.0:1784045189.505343:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784045189.505348:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829718912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.505483:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829718912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.505490:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784045189.505525:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829718912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.506043:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8332:1870706829719040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.506083:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.506105:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719040 00000100:00100000:0.0:1784045189.506108:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719040 00000100:00100000:0.0:1784045189.506129:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784045189.506136:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:8332:x1870706829719040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.506305:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:8332:x1870706829719040:12345-0@lo:502:llog_process_th.0 Request processed in 169us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.506312:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784045189.506344:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.506358:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8332:1870706829719040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.506399:0:8332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8332:1870706829719168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.506427:0:8332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.506443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719168 00000100:00100000:0.0:1784045189.506447:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719168 00000100:00100000:0.0:1784045189.506465:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784045189.506470:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:8332:x1870706829719168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.506585:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:8332:x1870706829719168:12345-0@lo:502:llog_process_th.0 Request processed in 114us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.506592:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784045189.506617:0:8332:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.506629:0:8332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8332:1870706829719168:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784045189.506646:0:8332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784045189.506690:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784045189.507109:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045189.507120:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.507130:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045189.507139:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784045189.507141:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1784045189.507144:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784045189.507179:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.507187:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.507203:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045189.507218:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.507246:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.507307:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.515627:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719296 00000100:00100000:2.0:1784045189.515642:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719296 00000100:00100000:0.0:1784045189.515844:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784045189.515855:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:5801:x1870706829719296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045189.515876:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045189.515896:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cd1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd14 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.515925:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd14 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.515936:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cd1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd14 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.515946:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030400, rc 0) 00000100:00100000:0.0:1784045189.516037:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829719296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (8789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.516044:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784045189.516103:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045189.516121:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.516149:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045189.516234:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.516266:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.516298:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.516315:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719424 00000100:00100000:0.0:1784045189.516318:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719424 00000100:00100000:0.0:1784045189.516341:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784045189.516347:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829719424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.516589:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829719424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.516596:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784045189.516617:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.516643:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.516679:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.516692:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.516722:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719552 00000100:00100000:0.0:1784045189.516726:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719552 00000100:00100000:0.0:1784045189.516744:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784045189.516750:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829719552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.516908:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829719552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.516915:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784045189.516957:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045189.519378:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8334:1870706829719680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045189.519459:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.519505:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.519585:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719680 00000100:00100000:0.0:1784045189.519592:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719680 00000100:00100000:0.0:1784045189.519671:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784045189.519681:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:8334:x1870706829719680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.519936:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:8334:x1870706829719680:12345-0@lo:502:llog_process_th.0 Request processed in 256us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.519944:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784045189.521940:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8334:1870706829719680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045189.521992:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045189.522003:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045189.522005:0:8334:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784045189.522010:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784045189.522044:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8334:1870706829719808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045189.522105:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.527495:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.527579:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719808 00000100:00100000:3.0:1784045189.527588:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719808 00000100:00100000:3.0:1784045189.527637:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784045189.527646:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:8334:x1870706829719808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045189.528129:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:8334:x1870706829719808:12345-0@lo:502:llog_process_th.0 Request processed in 483us (6023us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.528138:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784045189.528374:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8334:1870706829719808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045189.528883:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045189.528893:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045189.528895:0:8334:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784045189.528900:0:8334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1784045189.529052:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1784045189.529074:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784045189.529086:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.529097:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045189.529107:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784045189.529110:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa90538d800 from 39 10000000:01000000:0.0:1784045189.529112:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784045189.529145:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.529153:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.529176:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045189.529198:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.529254:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.529295:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.529447:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829719936 00000100:00100000:2.0:1784045189.529453:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829719936 00000100:00100000:3.0:1784045189.531862:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784045189.531879:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829719936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045189.531898:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045189.531917:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cd29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd22 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.531945:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd22 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.531970:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd22 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.531980:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172e00, rc 0) 00000100:00100000:3.0:1784045189.532064:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829719936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.532082:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784045189.532193:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d061f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829719936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045189.532212:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.532222:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045189.532295:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045189.532329:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.540468:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045189.540566:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720064 00000100:00100000:0.0:1784045189.540574:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720064 00000100:00100000:3.0:1784045189.540841:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784045189.540854:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829720064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.541254:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829720064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (8922us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.541263:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784045189.541525:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.541575:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.541619:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.541649:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930a70540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.541793:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720192 00000100:00100000:2.0:1784045189.541798:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720192 00000100:00100000:2.0:1784045189.541859:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784045189.541868:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829720192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045189.542137:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829720192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045189.542153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784045189.542240:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.543207:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8337:1870706829720320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045189.543258:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.543295:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930a700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.543343:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720320 00000100:00100000:2.0:1784045189.543349:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720320 00000100:00100000:2.0:1784045189.543389:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784045189.543397:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8337:x1870706829720320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045189.543604:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8337:x1870706829720320:12345-0@lo:502:llog_process_th.0 Request processed in 207us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045189.543611:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784045189.543693:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8337:1870706829720320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045189.543744:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8337:1870706829720448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045189.543778:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.543800:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93463dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.544215:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720448 00000100:00100000:2.0:1784045189.544221:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720448 00000100:00100000:2.0:1784045189.544251:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784045189.544259:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8337:x1870706829720448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045189.544404:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8337:x1870706829720448:12345-0@lo:502:llog_process_th.0 Request processed in 145us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045189.544411:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784045189.544516:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8337:1870706829720448:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784045189.544538:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784045189.544689:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784045189.544718:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045189.544728:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.544739:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045189.544748:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784045189.544751:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1784045189.544755:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784045189.544781:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.544796:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.544807:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045189.544823:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045189.544884:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.544910:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced9180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.545085:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720576 00000100:00100000:3.0:1784045189.545090:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720576 00000100:00100000:3.0:1784045189.545131:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045189.545138:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829720576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045189.545148:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045189.545172:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cd37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd30 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.545195:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cd37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd30 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.545206:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cd37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd30 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.545215:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173200, rc 0) 00000100:00100000:3.0:1784045189.545251:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829720576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.545257:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045189.545283:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045189.545295:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.545305:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045189.545346:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.545371:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.545378:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930a700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.545393:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720704 00000100:00100000:3.0:1784045189.545397:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720704 00000100:00100000:3.0:1784045189.545418:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784045189.545423:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829720704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.545635:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829720704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.545643:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784045189.545664:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.545689:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.545739:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.545747:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930a700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.545765:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720832 00000100:00100000:3.0:1784045189.545768:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720832 00000100:00100000:3.0:1784045189.545783:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784045189.545788:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829720832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.545934:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829720832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.545941:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784045189.546097:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829720832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045189.546642:0:8338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d062680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8338:1870706829720960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045189.546681:0:8338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.546723:0:8338:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa907e9ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.546766:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829720960 00000100:00100000:3.0:1784045189.546770:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829720960 00000100:00100000:3.0:1784045189.546802:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784045189.546810:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8338:x1870706829720960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045189.547149:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8338:x1870706829720960:12345-0@lo:502:llog_process_th.0 Request processed in 339us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.547156:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784045189.547248:0:8338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d062680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8338:1870706829720960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045189.547273:0:8338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045189.547282:0:8338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045189.547285:0:8338:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784045189.547290:0:8338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784045189.547312:0:8338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8338:1870706829721088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045189.547347:0:8338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045189.547375:0:8338:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced9600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045189.547492:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721088 00000100:00100000:3.0:1784045189.547503:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721088 00000100:00100000:3.0:1784045189.547535:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784045189.547542:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8338:x1870706829721088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045189.547677:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8338:x1870706829721088:12345-0@lo:502:llog_process_th.0 Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045189.547684:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784045189.547732:0:8338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8338:1870706829721088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045189.547751:0:8338:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045189.547755:0:8338:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045189.547757:0:8338:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784045189.547761:0:8338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784045189.547809:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784045189.547824:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784045189.547853:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.547863:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045189.547873:0:5801:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784045189.547876:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa907f44d40 from 1 10000000:01000000:3.0:1784045189.547879:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784045189.547901:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.547910:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.547919:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045189.547940:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829721216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.548136:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.548173:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.548276:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721216 00000100:00100000:2.0:1784045189.548281:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721216 00000100:00100000:2.0:1784045189.548313:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784045189.548320:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829721216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045189.548330:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045189.548342:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720e00/0xdb5b5ff6a2d2cd45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd3e expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.548364:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720e00/0xdb5b5ff6a2d2cd45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd3e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.548388:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720e00/0xdb5b5ff6a2d2cd45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd3e expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.548397:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720e00, rc 0) 00000100:00100000:2.0:1784045189.548428:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829721216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045189.548434:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1784045189.548502:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829721216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045189.548516:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045189.548525:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045189.548567:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829721344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045189.548592:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045189.548653:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.554051:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721344 00000100:00100000:2.0:1784045189.554063:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721344 00000100:00100000:2.0:1784045189.554112:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784045189.554122:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829721344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045189.554436:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829721344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (5842us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045189.554446:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784045189.554742:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829721344:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784045189.554780:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784045189.554789:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045189.554799:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784045190.153087:0:8370:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd65e92be0 20000000:00000080:3.0:1784045190.153104:0:8370:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa92d3b7c00 uarg=0000000000000000 20000000:01000000:3.0:1784045190.153139:0:8370:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784045190.153145:0:8370:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784045190.153164:0:8370:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784045190.154586:0:8371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784045190.155573:0:8370:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1784045190.161118:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1784045190.161198:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1784045190.161274:0:8370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1784045190.161293:0:8370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784045190.161314:0:8370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161333:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161352:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161359:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161369:0:8370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161378:0:8370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161421:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161457:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 9 pid: 5797 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.161473:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721472:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045190.161570:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161579:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 18 pid: 5799 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.161588:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721600:0@lo:104: 00000100:00100000:3.0:1784045190.161625:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045190.161668:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161684:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 18 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.161693:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721728:0@lo:104: 00000100:00100000:3.0:1784045190.161731:0:8370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045190.161755:0:8370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.161764:0:8370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 18 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.161771:0:8370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721856:0@lo:104: 00000100:00100000:3.0:1784045190.161790:0:8370:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045190.162286:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784045190.162308:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045190.162320:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721600 00000100:00100000:0.0:1784045190.162327:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721600 00000100:00100000:0.0:1784045190.162363:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721728 00000100:00100000:0.0:1784045190.162367:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721728 00000100:00100000:0.0:1784045190.162377:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721856 00000100:00100000:0.0:1784045190.162379:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721856 00000100:00100000:0.0:1784045190.162391:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045190.162400:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:8370:x1870706829721600:12345-0@lo:104: 00010000:00010000:0.0:1784045190.162414:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162486:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045190.162493:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:8370:x1870706829721600:12345-0@lo:104: Request processed in 94us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045190.162500:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045190.162517:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784045190.162522:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:8370:x1870706829721728:12345-0@lo:104: 00010000:00010000:0.0:1784045190.162529:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162573:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784045190.162578:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:8370:x1870706829721728:12345-0@lo:104: Request processed in 56us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045190.162584:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784045190.162619:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045190.162625:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:8370:x1870706829721856:12345-0@lo:104: 00010000:00010000:0.0:1784045190.162633:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162658:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784045190.162662:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:8370:x1870706829721856:12345-0@lo:104: Request processed in 38us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045190.162668:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1784045190.162685:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784045190.162691:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162880:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045190.162885:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162893:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045190.162901:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045190.162907:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045190.162963:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162969:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045190.162988:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.162996:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148f600/0xdb5b5ff6a2d2cbe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cbee expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163010:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045190.163014:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163019:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045190.163022:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163028:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045190.163034:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045190.163039:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045190.163052:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163058:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045190.163064:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163081:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cb1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cb23 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163091:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045190.163094:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163099:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045190.163102:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163108:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045190.163114:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045190.163118:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045190.163131:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163137:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045190.163164:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163171:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937720800/0xdb5b5ff6a2d2caba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cac1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163184:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045190.163192:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045190.163193:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045190.163200:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045190.163213:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829721984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045190.163259:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045190.163285:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045190.163291:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829722112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045190.163310:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045190.163335:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045190.163342:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829722240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045190.163363:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045190.163388:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829721984 00000100:00100000:0.0:1784045190.163392:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829721984 00010000:00010000:0.0:1784045190.163413:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 19 pid: 5799 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045190.163430:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722112 00000100:00100000:0.0:1784045190.163432:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722112 00010000:00010000:0.0:1784045190.163441:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 20 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045190.163470:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722240 00000100:00100000:0.0:1784045190.163473:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722240 00010000:00010000:0.0:1784045190.163484:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 21 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045190.163496:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045190.163501:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3318:x1870706829721984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045190.163510:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045190.163515:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 21 pid: 5799 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163532:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 21 pid: 5799 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163548:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045190.163578:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3318:x1870706829721984:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045190.163584:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045190.163600:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045190.163606:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3318:x1870706829722112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045190.163614:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045190.163618:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 20 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163627:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 20 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163636:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045190.163658:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3318:x1870706829722112:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045190.163664:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045190.163677:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045190.163683:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829722240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045190.163690:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045190.163706:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 19 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163715:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 19 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045190.163732:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045190.163761:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829722240:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045190.163767:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045190.163801:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829722240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045190.163827:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829722112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045190.163855:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829721984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045190.164732:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cbee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cbe7 expref: 18 pid: 5799 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.164746:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721600:0@lo:104: 00010000:00010000:3.0:1784045190.164757:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa90148ea00/0xdb5b5ff6a2d2cb23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cb1c expref: 17 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.164765:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721728:0@lo:104: 00010000:00010000:3.0:1784045190.164774:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173600/0xdb5b5ff6a2d2cac1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2caba expref: 16 pid: 5796 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.164780:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721856:0@lo:104: 00000100:00100000:2.0:1784045190.169104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045190.169138:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723072 00000100:00100000:2.0:1784045190.169157:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723072 00010000:00010000:2.0:1784045190.169198:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 10 pid: 5797 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045190.169247:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:2.0:1784045190.169257:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2360:x1870706808723072:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045190.169273:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045190.169280:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 10 pid: 5797 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169313:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 10 pid: 5797 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169336:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169345:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169362:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169369:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169375:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169382:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169389:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045190.169394:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169403:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169414:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045190.169435:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045190.169498:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2360:x1870706808723072:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 241us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045190.169506:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00010000:00010000:3.0:1784045190.169821:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2ccab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc51 expref: 9 pid: 5797 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045190.169895:0:8370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8370:1870706829721472:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045190.169925:0:8370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.169950:0:8370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.169957:0:8370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045190.169963:0:8370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd4c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045190.371813:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045191.393949:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045191.585013:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829722368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045191.585087:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045191.585143:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722368 00000100:00100000:1.0:1784045191.585151:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722368 00000100:00100000:1.0:1784045191.585212:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784045191.585222:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829722368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045191.585331:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045191.588141:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829722368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2904us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045191.588161:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1784045191.588193:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045191.592093:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0bb80 x1870706829722368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045191.592133:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829722368:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1784045191.784973:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045191.784981:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa93f779800 from 4 10000000:01000000:2.0:1784045191.784986:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045191.785035:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045191.785048:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045191.785060:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045191.785089:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829722496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045191.785169:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045191.785220:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045191.785297:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722496 00000100:00100000:0.0:1784045191.785305:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722496 00000100:00100000:0.0:1784045191.785364:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784045191.785373:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829722496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045191.785389:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045191.785404:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd53 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045191.785428:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045191.785439:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045191.785449:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900031600, rc 0) 00000100:00100000:0.0:1784045191.785493:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829722496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045191.785500:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1784045191.785561:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829722496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045191.785575:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045191.785584:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045191.785632:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829722624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045191.785655:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045191.785669:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045191.785681:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722624 00000100:00100000:0.0:1784045191.785684:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722624 00000100:00100000:0.0:1784045191.785701:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784045191.785706:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829722624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045191.785965:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829722624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045191.785973:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784045191.786001:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829722624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045191.786028:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829722752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045191.786063:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045191.786077:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045191.786089:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722752 00000100:00100000:0.0:1784045191.786092:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722752 00000100:00100000:0.0:1784045191.786107:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784045191.786112:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829722752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045191.787630:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829722752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1510us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045191.787650:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784045191.791578:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829722752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.792132:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8432:1870706829722880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.792205:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.792289:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045191.796448:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829722880 00000100:00100000:2.0:1784045191.796460:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829722880 00000100:00100000:2.0:1784045191.796515:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784045191.796524:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8432:x1870706829722880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045191.796770:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8432:x1870706829722880:12345-0@lo:502:llog_process_th.0 Request processed in 246us (4564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045191.796778:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784045191.797338:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8432:1870706829722880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045191.797371:0:8432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045191.797381:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045191.797383:0:8432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045191.797395:0:8432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa93f779800 00000020:00000080:3.0:1784045191.797397:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045191.797477:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8432:1870706829723008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.797516:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.797553:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045191.797606:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723008 00000100:00100000:1.0:1784045191.797611:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723008 00000100:00100000:1.0:1784045191.797644:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784045191.797651:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8432:x1870706829723008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045191.797785:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:8432:x1870706829723008:12345-0@lo:502:llog_process_th.0 Request processed in 134us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045191.797792:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784045191.797939:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8432:1870706829723008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045191.797956:0:8432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045191.797960:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045191.797962:0:8432:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784045191.797965:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784045191.798139:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784045191.798161:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045191.798170:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045191.798180:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045191.798189:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045191.798191:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa907eaf000 from 4 10000000:01000000:1.0:1784045191.798194:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045191.798218:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045191.798225:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045191.798234:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045191.798256:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045191.798284:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045191.798308:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910195240 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.798480:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723136 00000100:00100000:3.0:1784045191.798485:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723136 00000100:00100000:3.0:1784045191.798512:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784045191.798519:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829723136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045191.798530:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045191.798543:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd61 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.798564:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.798573:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.798594:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173400, rc 0) 00000100:00100000:3.0:1784045191.798632:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829723136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.798637:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784045191.798669:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045191.798689:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.798699:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045191.798746:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.798814:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.798854:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.798867:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723264 00000100:00100000:3.0:1784045191.798871:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723264 00000100:00100000:3.0:1784045191.798893:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784045191.798898:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829723264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.799103:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829723264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.799110:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784045191.799153:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.799178:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.799208:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.799308:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.799322:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723392 00000100:00100000:3.0:1784045191.799326:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723392 00000100:00100000:3.0:1784045191.799347:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784045191.799353:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829723392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.799514:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829723392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.799530:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784045191.799564:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.799727:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8433:1870706829723520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.799760:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.799779:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723520 00000100:00100000:3.0:1784045191.799783:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723520 00000100:00100000:3.0:1784045191.799803:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784045191.799808:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8433:x1870706829723520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.799942:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8433:x1870706829723520:12345-0@lo:502:llog_process_th.0 Request processed in 132us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.799949:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784045191.799976:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.799989:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8433:1870706829723520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045191.800008:0:8433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045191.800017:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045191.800019:0:8433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045191.800025:0:8433:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa907eaf000 00000020:00000080:3.0:1784045191.800027:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045191.800084:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8433:1870706829723648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.800115:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.800149:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723648 00000100:00100000:3.0:1784045191.800152:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723648 00000100:00100000:3.0:1784045191.800173:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784045191.800178:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8433:x1870706829723648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.800283:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:8433:x1870706829723648:12345-0@lo:502:llog_process_th.0 Request processed in 103us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.800296:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784045191.800324:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.800336:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8433:1870706829723648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045191.800354:0:8433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045191.800358:0:8433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045191.800360:0:8433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784045191.800364:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784045191.800409:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784045191.800424:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045191.800433:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800442:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045191.800451:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045191.800453:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90538d800 from 4 10000000:01000000:3.0:1784045191.800456:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045191.800476:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800483:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800492:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045191.800506:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.800530:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.800551:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.800564:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723776 00000100:00100000:3.0:1784045191.800567:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723776 00000100:00100000:3.0:1784045191.800587:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784045191.800593:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829723776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045191.800602:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045191.800614:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cd6f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800634:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800644:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800653:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173000, rc 0) 00000100:00100000:3.0:1784045191.800680:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829723776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.800686:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784045191.800714:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045191.800726:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.800734:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045191.800770:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.800794:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.800813:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.800825:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829723904 00000100:00100000:3.0:1784045191.800851:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829723904 00000100:00100000:3.0:1784045191.800874:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784045191.800879:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829723904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.801058:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829723904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.801065:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784045191.801095:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829723904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.801135:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829724032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.801168:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.801180:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.801191:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724032 00000100:00100000:3.0:1784045191.801194:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724032 00000100:00100000:3.0:1784045191.801212:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784045191.801217:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829724032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.801325:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829724032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.801331:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784045191.801368:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829724032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045191.805435:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8434:1870706829724160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045191.805525:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045191.805567:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.814262:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724160 00000100:00100000:3.0:1784045191.814276:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724160 00000100:00100000:3.0:1784045191.814332:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784045191.814343:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:8434:x1870706829724160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.814616:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:8434:x1870706829724160:12345-0@lo:502:llog_process_th.0 Request processed in 275us (9091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.814631:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784045191.817204:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8434:1870706829724160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045191.817259:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045191.817274:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045191.817276:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045191.817284:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa90538d800 00000020:00000080:3.0:1784045191.817286:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045191.817809:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8434:1870706829724288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.818734:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045191.818775:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724288 00000100:00100000:3.0:1784045191.818782:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724288 00000100:00100000:3.0:1784045191.818842:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1784045191.818853:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:8434:x1870706829724288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045191.819063:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:8434:x1870706829724288:12345-0@lo:502:llog_process_th.0 Request processed in 211us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.819071:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1784045191.819136:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045191.819157:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:8434:1870706829724288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045191.819186:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045191.819193:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045191.819195:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784045191.819199:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784045191.819702:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784045191.819721:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045191.819730:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045191.819743:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045191.968542:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045191.968716:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723200 00000100:00100000:3.0:1784045191.968727:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723200 00000100:00100000:3.0:1784045191.968799:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:3.0:1784045191.968810:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:5579:x1870706808723200:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045191.968891:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045191.968910:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc90 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.968943:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.968955:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045191.968965:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045191.969018:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808723200:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 210us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.969025:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:2.0:1784045191.976961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045191.977106:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723328 00000100:00100000:3.0:1784045191.977126:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723328 00000100:00100000:3.0:1784045191.977188:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:3.0:1784045191.977198:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808723328:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045191.977545:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808723328:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 347us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045191.977552:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:2.0:1784045191.982882:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045191.983222:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723456 00000100:00100000:1.0:1784045191.983233:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723456 00000100:00100000:1.0:1784045191.983336:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:1.0:1784045191.983348:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808723456:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045191.983608:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:5579:x1870706808723456:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 260us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045191.983617:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:2.0:1784045191.993634:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045191.993731:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723584 00000100:00100000:0.0:1784045191.993740:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723584 00000100:00100000:0.0:1784045191.993796:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:0.0:1784045191.993807:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:6111:x1870706808723584:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045191.994108:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:6111:x1870706808723584:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 302us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045191.994126:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:2.0:1784045192.002593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045192.002747:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723712 00000100:00100000:1.0:1784045192.002757:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723712 00000100:00100000:2.0:1784045192.003250:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:2.0:1784045192.003264:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:6111:x1870706808723712:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045192.003514:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:6111:x1870706808723712:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 254us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045192.003522:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 190 00010000:00010000:1.0:1784045192.428417:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045193.441160:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045193.635163:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045193.635242:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045193.635305:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724416 00000100:00100000:2.0:1784045193.635314:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724416 00000100:00100000:1.0:1784045193.635317:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829724928:0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.635348:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045193.635385:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045193.635387:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784045193.635395:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829724544:0@lo:400:kworker.0 00000100:00100000:2.0:1784045193.635411:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829724416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045193.635428:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1784045193.635452:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045193.635452:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829725056:0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.635484:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045193.635512:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829724416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (270us total) trans 0 rc 0/0 00010000:00080000:1.0:1784045193.635527:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d053480 x1870706829724416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045193.635547:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045193.635572:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045193.635584:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724928 00000100:00100000:2.0:1784045193.635589:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724928 00000100:00100000:1.0:1784045193.635612:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725056 00000100:00100000:1.0:1784045193.635617:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725056 00000100:00100000:2.0:1784045193.635623:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045193.635632:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829724928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.635656:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045193.635665:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829725056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045193.635697:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829724928:12345-0@lo:400:kworker.0 Request processed in 65us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045193.635706:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784045193.635712:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829725056:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045193.635719:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1784045193.635726:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045193.635732:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045193.635735:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045193.635766:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829725056:0@lo:400:kworker.0 00010000:00080000:2.0:1784045193.635778:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08700 x1870706829724928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045193.635788:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829724928:0@lo:400:kworker.0 00000100:00100000:3.0:1784045193.636769:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829724672:0@lo:400:kworker.0 00000100:00100000:3.0:1784045193.636824:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045193.636902:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829725184:0@lo:400:kworker.0 00000100:00100000:3.0:1784045193.636925:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045193.636945:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045193.636964:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829724800:0@lo:400:kworker.0 00000100:00100000:3.0:1784045193.636986:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045193.637019:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724544 00000100:00100000:3.0:1784045193.637024:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724544 00000100:00100000:3.0:1784045193.637058:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784045193.637064:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045193.637114:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829724544:12345-0@lo:400:kworker.0 Request processed in 50us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045193.637129:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1784045193.638403:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724672 00000100:00100000:1.0:1784045193.638414:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724672 00000100:00100000:1.0:1784045193.638472:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829724800 00000100:00100000:1.0:1784045193.638475:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829724800 00000100:00100000:1.0:1784045193.638519:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045193.638527:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829724672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.638594:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829724672:12345-0@lo:400:kworker.0 Request processed in 67us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045193.638601:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045193.638617:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045193.638624:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829724800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.638653:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829724800:12345-0@lo:400:kworker.0 Request processed in 30us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045193.638659:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045193.638678:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725184 00000100:00100000:1.0:1784045193.638681:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725184 00000100:00100000:1.0:1784045193.638707:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784045193.638713:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829725184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.638756:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829725184:12345-0@lo:400:kworker.0 Request processed in 43us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045193.638763:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784045193.638810:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829724800:0@lo:400:kworker.0 00000100:00100000:1.0:1784045193.638822:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829724672:0@lo:400:kworker.0 00010000:00080000:1.0:1784045193.638861:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08380 x1870706829725184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045193.638871:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829725184:0@lo:400:kworker.0 00000100:00100000:2.0:1784045193.639131:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829724544:0@lo:400:kworker.0 00000100:00080000:3.0:1784045193.643015:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045194.144025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045194.144068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045194.144105:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045194.144134:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045194.144162:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723968 00000100:00100000:1.0:1784045194.144171:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723968 00000100:00100000:3.0:1784045194.144283:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808723840 00000100:00100000:3.0:1784045194.144287:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808723840 00000100:00100000:3.0:1784045194.144331:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:3.0:1784045194.144341:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808723840:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045194.144413:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808723840:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 73us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045194.144421:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00080000:3.0:1784045194.144449:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045194.144866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784045194.144988:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808723968:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045194.145041:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808723968:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 166us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045194.145048:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784045194.145075:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724096 00000100:00100000:1.0:1784045194.145090:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724096 00000100:00100000:1.0:1784045194.145120:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724224 00000100:00100000:1.0:1784045194.145124:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724224 00000100:00100000:1.0:1784045194.145139:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1784045194.145146:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724096:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045194.145185:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724096:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045194.145193:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00080000:3.0:1784045194.145321:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045194.145325:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045194.145575:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784045194.145585:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724224:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045194.145805:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724224:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 48us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045194.145813:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00010000:00010000:1.0:1784045194.467873:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045195.496874:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045196.513205:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045196.705064:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829725312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045196.705143:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045196.705236:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725312 00000100:00100000:3.0:1784045196.705245:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725312 00000100:00100000:3.0:1784045196.705316:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784045196.705326:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829725312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045196.705377:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045196.705422:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829725312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045196.705442:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1784045196.705466:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045196.705495:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d050380 x1870706829725312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045196.705512:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829725312:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784045197.382936:0:8670:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1784045197.544180:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045198.561024:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045198.753097:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829725440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045198.753173:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045198.753258:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725440 00000100:00100000:1.0:1784045198.753265:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725440 00000100:00100000:1.0:1784045198.753324:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045198.753333:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829725440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045198.753370:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045198.753416:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829725440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045198.753424:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1784045198.753445:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784045198.753491:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191f100 x1870706829725440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045198.753510:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829725440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045198.754209:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045198.754244:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829725568:0@lo:400:kworker.0 00000100:00100000:1.0:1784045198.754283:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045198.754336:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829725696:0@lo:400:kworker.0 00000100:00100000:1.0:1784045198.754360:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045198.754393:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725696 00000100:00100000:1.0:1784045198.754397:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725696 00000100:00100000:1.0:1784045198.754430:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045198.754437:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829725696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045198.754656:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725568 00000100:00100000:2.0:1784045198.754660:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725568 00000100:00100000:2.0:1784045198.754692:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784045198.754700:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829725568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045198.755107:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829725568:12345-0@lo:400:kworker.0 Request processed in 407us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045198.755115:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784045198.756429:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829725696:12345-0@lo:400:kworker.0 Request processed in 1986us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045198.756440:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784045198.757663:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829725696:0@lo:400:kworker.0 00000100:00100000:1.0:1784045198.758196:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829725568:0@lo:400:kworker.0 00000100:00100000:0.0:1784045198.758676:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829725952:0@lo:400:kworker.0 00000100:00100000:0.0:1784045198.758732:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045198.758790:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045198.759078:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725952 00000100:00100000:1.0:1784045198.759084:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725952 00000100:00100000:1.0:1784045198.759137:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045198.759146:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829725952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045198.759219:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829725824:0@lo:400:kworker.0 00000100:00100000:3.0:1784045198.759248:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045198.759276:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829725824 00000100:00100000:3.0:1784045198.759280:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829725824 00000100:00100000:3.0:1784045198.759310:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045198.759316:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829725824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045198.759351:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829725824:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045198.759358:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045198.759393:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829725824:0@lo:400:kworker.0 00000100:00100000:3.0:1784045198.759423:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829726080:0@lo:400:kworker.0 00000100:00100000:3.0:1784045198.759445:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045198.759594:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726080 00000100:00100000:3.0:1784045198.759611:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726080 00000100:00100000:3.0:1784045198.759637:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045198.759643:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829726080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045198.759677:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829726080:12345-0@lo:400:kworker.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045198.759684:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045198.759706:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829726080:0@lo:400:kworker.0 00000100:00100000:1.0:1784045198.762782:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829725952:12345-0@lo:400:kworker.0 Request processed in 3627us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045198.762810:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1784045198.762878:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045198.762885:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045198.763661:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08700 x1870706829725952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045198.763680:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829725952:0@lo:400:kworker.0 00000100:00100000:1.0:1784045199.265060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045199.265136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045199.265164:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045199.265189:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045199.265212:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724480 00000100:00100000:1.0:1784045199.265220:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724480 00000100:00100000:1.0:1784045199.265287:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1784045199.265297:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808724480:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045199.265373:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808724480:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045199.265392:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1784045199.265417:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724608 00000100:00100000:1.0:1784045199.265420:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724608 00000100:00100000:1.0:1784045199.265443:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724736 00000100:00100000:1.0:1784045199.265446:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724736 00000100:00100000:1.0:1784045199.265462:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784045199.265468:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724608:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045199.265496:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724608:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045199.265502:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784045199.265512:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784045199.265518:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724736:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045199.265539:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808724736:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045199.265558:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00080000:1.0:1784045199.265574:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045199.265578:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045199.265580:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045199.268134:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724352 00000100:00100000:2.0:1784045199.268149:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724352 00000100:00100000:2.0:1784045199.268279:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 194 00000100:00100000:2.0:1784045199.268289:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808724352:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045199.268362:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808724352:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 75us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045199.268370:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 194 00010000:00010000:0.0:1784045199.584975:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045200.610414:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045201.634230:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045201.826017:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829726208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045201.826113:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045201.826197:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726208 00000100:00100000:1.0:1784045201.826214:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726208 00000100:00100000:1.0:1784045201.826272:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045201.826282:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829726208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045201.826319:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045201.826367:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829726208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045201.826374:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1784045201.826397:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045201.826426:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191c000 x1870706829726208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045201.826445:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829726208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045202.657002:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045203.681259:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045203.708220:0:8914:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing yml_node 00000100:00100000:2.0:1784045203.873587:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829726464:0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.873663:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.873720:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829726976:0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.873747:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.873780:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045203.873787:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829726592:0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.873809:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.873867:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726464 00000100:00100000:2.0:1784045203.873875:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726464 00000100:00100000:2.0:1784045203.873925:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726592 00000100:00100000:2.0:1784045203.873929:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726592 00000100:00100000:2.0:1784045203.873957:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784045203.873964:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.874019:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829726464:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.874089:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784045203.874110:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784045203.874117:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829726592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.874209:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829726592:12345-0@lo:400:kworker.0 Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.874225:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784045203.874244:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726976 00000100:00100000:2.0:1784045203.874248:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726976 00000100:00100000:2.0:1784045203.874275:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045203.874281:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829726976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045203.874429:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829726336:0@lo:400:kworker.0 00000100:00100000:1.0:1784045203.874464:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.874488:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829726848:0@lo:400:kworker.0 00000100:00100000:1.0:1784045203.874510:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.874528:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045203.874533:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829726720:0@lo:400:kworker.0 00000100:00100000:1.0:1784045203.874555:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.874616:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045203.874624:0:6599:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1784045203.874769:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726720 00000100:00100000:1.0:1784045203.874774:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726720 00000100:00100000:1.0:1784045203.874796:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045203.874804:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784045203.874810:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829726720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045203.874862:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829726720:12345-0@lo:400:kworker.0 Request processed in 52us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.874874:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1784045203.874911:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd09f80 x1870706829726720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045203.874938:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829726720:0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.875205:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829726976:12345-0@lo:400:kworker.0 Request processed in 922us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.875213:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045203.875230:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726848 00000100:00100000:2.0:1784045203.875235:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726848 00000100:00100000:2.0:1784045203.875255:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784045203.875262:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829726848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.875558:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829726848:12345-0@lo:400:kworker.0 Request processed in 294us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.875565:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1784045203.875586:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045203.875590:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045203.875593:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045203.875609:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829726336 00000100:00100000:2.0:1784045203.875612:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829726336 00000100:00100000:2.0:1784045203.875639:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784045203.875645:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829726336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.875677:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829726336:12345-0@lo:400:kworker.0 Request processed in 33us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.875684:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784045203.875714:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829727104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045203.875753:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.875785:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727104 00000100:00100000:2.0:1784045203.875789:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727104 00000100:00100000:2.0:1784045203.875811:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045203.875817:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829727104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045203.875869:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045203.875905:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829727104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.875911:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1784045203.875954:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191e300 x1870706829727104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045203.875970:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829727104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045203.877351:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829726336:0@lo:400:kworker.0 00000100:00100000:1.0:1784045203.877370:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829726848:0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.877484:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829726592:0@lo:400:kworker.0 00000100:00100000:2.0:1784045203.877505:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829726464:0@lo:400:kworker.0 00010000:00080000:2.0:1784045203.877516:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0a680 x1870706829726976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045203.877525:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829726976:0@lo:400:kworker.0 00000100:00100000:3.0:1784045204.393561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045204.393616:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045204.393849:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724864 00000100:00100000:3.0:1784045204.393858:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724864 00000100:00100000:3.0:1784045204.393903:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1784045204.393924:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808724864:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045204.393993:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808724864:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 70us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045204.394001:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1784045204.394032:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808724992 00000100:00100000:3.0:1784045204.394036:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808724992 00000100:00100000:3.0:1784045204.394071:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:3.0:1784045204.394077:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808724992:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045204.394108:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808724992:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045204.394114:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00080000:3.0:1784045204.396420:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045204.402235:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045204.402268:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045204.402367:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725120 00000100:00100000:3.0:1784045204.402378:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725120 00000100:00100000:3.0:1784045204.402441:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725248 00000100:00100000:3.0:1784045204.402444:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725248 00000100:00100000:3.0:1784045204.402466:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784045204.402475:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2359:x1870706808725120:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:3.0:1784045204.402510:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ccb9 00000100:00080000:3.0:1784045204.402519:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa93f752000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784045204.402556:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784045204.403170:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784045204.403182:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2359:x1870706808725248:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:2.0:1784045204.403204:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ccc0 00000100:00080000:2.0:1784045204.403212:0:6600:0:(import.c:65:import_set_state_nolock()) ffff8aa93f753800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784045204.403240:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784045204.405504:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+2:2359:x1870706808725120:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 3020us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045204.405518:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00080000:3.0:1784045204.405559:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045204.405564:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784045204.405747:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045204.405753:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045204.411046:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+2:2359:x1870706808725248:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 7849us (8758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045204.411072:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00010000:00010000:2.0:1784045204.715194:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045205.729107:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045206.753151:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045206.945211:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045206.945243:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829727232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045206.945325:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045206.945744:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727232 00000100:00100000:1.0:1784045206.945753:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727232 00000100:00100000:1.0:1784045206.945853:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045206.945872:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829727232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045206.945909:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045206.945970:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829727232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045206.945977:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1784045206.946116:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045206.946196:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0a680 x1870706829727232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045206.946227:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829727232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784045207.786822:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784045208.551939:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:1.0:1784045208.551949:0:7510:0:(genops.c:906:class_export_put()) final put ffff8aa93f757800/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:3.0:1784045208.552181:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f757800/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 for lustre-OST0001 00000020:00000080:3.0:1784045208.552230:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f753800 for lustre-OST0001 00010000:00010000:1.0:1784045208.809120:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045208.962800:0:9107:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00000100:00100000:3.0:1784045208.994291:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829727360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045208.994360:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045208.994446:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727360 00000100:00100000:3.0:1784045208.994454:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727360 00000100:00100000:3.0:1784045208.994511:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045208.994520:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829727360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045208.994556:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045208.994601:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829727360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045208.994616:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1784045208.994648:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784045208.994679:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d050e00 x1870706829727360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045208.994698:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829727360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045208.994799:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829727616:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.994827:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045208.994877:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784045208.994883:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829727488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.994909:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045208.994931:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829728000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.994952:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045208.994976:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727616 00000100:00100000:3.0:1784045208.994980:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727616 00000100:00100000:3.0:1784045208.995017:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728000 00000100:00100000:3.0:1784045208.995020:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728000 00000100:00100000:3.0:1784045208.995042:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045208.995048:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829727616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995084:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829727616:12345-0@lo:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045208.995091:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045208.995102:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045208.995108:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829728000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995134:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829728000:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045208.995148:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045208.995167:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727488 00000100:00100000:3.0:1784045208.995171:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727488 00000100:00100000:3.0:1784045208.995193:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784045208.995199:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829727488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995226:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829727488:12345-0@lo:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045208.995232:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784045208.995266:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829727744:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995287:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045208.995303:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045208.995309:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829727872:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995330:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045208.995352:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727872 00000100:00100000:3.0:1784045208.995355:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727872 00000100:00100000:3.0:1784045208.995381:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045208.995386:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829727872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995415:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829727872:12345-0@lo:400:kworker.0 Request processed in 28us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045208.995420:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1784045208.995433:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045208.995436:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784045208.995449:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa9082a3b80 x1870706829727872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045208.995460:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829727872:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995478:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829727488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995494:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829728000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995501:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829727616:0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995520:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829727744 00000100:00100000:3.0:1784045208.995523:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829727744 00000100:00100000:3.0:1784045208.995543:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045208.995547:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829727744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045208.995577:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829727744:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045208.995582:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1784045208.995598:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045208.995613:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829727744:0@lo:400:kworker.0 00000100:00100000:3.0:1784045209.508729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045209.508769:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045209.508812:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725504 00000100:00100000:3.0:1784045209.508848:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725504 00000100:00100000:3.0:1784045209.508906:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:3.0:1784045209.508927:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808725504:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045209.508995:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808725504:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045209.509002:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:3.0:1784045209.509025:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725376 00000100:00100000:3.0:1784045209.509028:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725376 00000100:00100000:3.0:1784045209.509047:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 198 00000100:00100000:3.0:1784045209.509053:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808725376:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045209.509075:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2362:x1870706808725376:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045209.509094:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 198 00000100:00080000:3.0:1784045209.510693:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1784045209.603567:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:0.0:1784045209.603577:0:6626:0:(genops.c:906:class_export_put()) final put ffff8aa93f750000/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:3.0:1784045209.603711:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f750000/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 for lustre-OST0000 00000020:00000080:3.0:1784045209.604058:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f752000 for lustre-OST0000 00010000:00010000:2.0:1784045209.827383:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045210.849080:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045211.873125:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045211.879674:0:9205:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00000100:00100000:0.0:1784045212.065202:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045212.065226:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045212.065296:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045212.065684:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728128 00000100:00100000:2.0:1784045212.065694:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728128 00000100:00100000:2.0:1784045212.065758:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784045212.065768:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829728128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045212.065855:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045212.065911:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829728128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.065918:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1784045212.065965:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08700 x1870706829728128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045212.065984:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829728128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784045212.066149:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045212.896998:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045213.921490:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045214.113869:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829728256:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.113978:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045214.115978:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829728768:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.116061:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045214.116106:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045214.116115:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829728384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045214.116144:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045214.116187:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728384 00000100:00100000:0.0:1784045214.116198:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728384 00000100:00100000:0.0:1784045214.116282:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045214.116293:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829728384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045214.116351:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045214.116403:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829728384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.116412:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1784045214.116439:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784045214.116474:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd09180 x1870706829728384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045214.116497:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829728384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045214.116544:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728768 00000100:00100000:0.0:1784045214.116548:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728768 00000100:00100000:0.0:1784045214.116583:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045214.116590:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829728768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.116626:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829728768:12345-0@lo:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.116643:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1784045214.116661:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045214.116676:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa9082a0a80 x1870706829728768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045214.116686:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829728768:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.116723:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829728512:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.116769:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045214.116792:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045214.116798:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829728640:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.116819:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045214.116887:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728256 00000100:00100000:0.0:1784045214.116893:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728256 00000100:00100000:0.0:1784045214.116927:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784045214.116935:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829728256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.116972:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829728256:12345-0@lo:400:kworker.0 Request processed in 38us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.116979:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784045214.117013:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829728256:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.117059:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728512 00000100:00100000:0.0:1784045214.117063:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728512 00000100:00100000:0.0:1784045214.117089:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728640 00000100:00100000:0.0:1784045214.117092:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728640 00000100:00100000:0.0:1784045214.117118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045214.117124:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829728512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.117159:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829728512:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.117172:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045214.117183:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784045214.117189:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829728640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.117216:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829728640:12345-0@lo:400:kworker.0 Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.117222:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1784045214.117244:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045214.117261:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829728640:0@lo:400:kworker.0 00000100:00100000:0.0:1784045214.117270:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829728512:0@lo:400:kworker.0 00000100:00100000:1.0:1784045214.118037:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829728896:0@lo:400:kworker.0 00000100:00100000:1.0:1784045214.118085:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045214.118131:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829728896 00000100:00100000:3.0:1784045214.118138:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829728896 00000100:00100000:3.0:1784045214.118199:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045214.118208:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829728896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784045214.118260:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045214.118391:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829728896:12345-0@lo:400:kworker.0 Request processed in 185us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045214.118399:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784045214.118643:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829728896:0@lo:400:kworker.0 00000100:00100000:3.0:1784045214.624498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045214.624583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045214.624617:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725632 00000100:00100000:3.0:1784045214.624626:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725632 00000100:00100000:3.0:1784045214.624684:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:3.0:1784045214.624695:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808725632:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045214.624777:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808725632:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045214.624785:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:0.0:1784045214.627346:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725760 00000100:00100000:0.0:1784045214.627360:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725760 00000100:00100000:0.0:1784045214.627432:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1784045214.627443:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808725760:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045214.627518:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808725760:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 78us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.627526:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00080000:1.0:1784045214.628855:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784045214.955698:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045214.982922:0:9304:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:2.0:1784045215.980923:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784045216.970646:0:9352:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jul 14 12:06:55 EDT 2026 00010000:00010000:1.0:1784045216.996604:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045217.185093:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829729024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045217.185177:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045217.185273:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729024 00000100:00100000:1.0:1784045217.185285:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729024 00000100:00100000:1.0:1784045217.185338:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784045217.185346:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829729024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045217.185394:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045217.185435:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829729024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045217.185442:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1784045217.185463:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045217.185669:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08e00 x1870706829729024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045217.185697:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829729024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045218.021683:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045219.041558:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045219.233180:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045219.233206:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829729152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045219.233294:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045219.233419:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729152 00000100:00100000:1.0:1784045219.233427:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729152 00000100:00100000:1.0:1784045219.233501:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045219.233511:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829729152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045219.233547:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045219.233592:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829729152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045219.233599:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1784045219.233683:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784045219.233713:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08e00 x1870706829729152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045219.233730:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829729152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045219.234212:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829729280:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234251:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045219.234402:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829729792:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234482:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045219.234507:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045219.234513:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829729408:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234548:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045219.234578:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729792 00000100:00100000:0.0:1784045219.234582:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729792 00000100:00100000:0.0:1784045219.234615:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729408 00000100:00100000:0.0:1784045219.234619:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729408 00000100:00100000:0.0:1784045219.234639:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784045219.234670:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829729792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234712:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829729792:12345-0@lo:400:kworker.0 Request processed in 43us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045219.234718:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784045219.234732:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045219.234738:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829729408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234767:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829729408:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045219.234773:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045219.234797:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829729664:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234825:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045219.234879:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045219.234885:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829729536:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.234908:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045219.234932:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729664 00000100:00100000:0.0:1784045219.234936:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729664 00000100:00100000:0.0:1784045219.234966:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045219.234973:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829729664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.235007:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829729664:12345-0@lo:400:kworker.0 Request processed in 34us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045219.235013:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1784045219.235055:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0a680 x1870706829729664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045219.235067:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829729664:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.235085:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729536 00000100:00100000:0.0:1784045219.235089:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729536 00000100:00100000:0.0:1784045219.235111:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045219.235117:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829729536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.235150:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829729536:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045219.235156:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045219.235182:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829729536:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.235202:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829729408:0@lo:400:kworker.0 00000100:00100000:0.0:1784045219.235211:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829729792:0@lo:400:kworker.0 00000100:00080000:2.0:1784045219.235340:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045219.235344:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045219.235736:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729280 00000100:00100000:3.0:1784045219.235741:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729280 00000100:00100000:2.0:1784045219.235907:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784045219.235915:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829729280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045219.235968:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829729280:12345-0@lo:400:kworker.0 Request processed in 55us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045219.235975:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784045219.236056:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829729280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045219.744341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045219.744397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045219.744606:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726016 00000100:00100000:0.0:1784045219.744615:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726016 00000100:00100000:0.0:1784045219.744705:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:0.0:1784045219.744716:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808726016:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045219.744787:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808726016:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 73us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045219.744795:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00080000:2.0:1784045219.745059:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045219.748999:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808725888 00000100:00100000:1.0:1784045219.749028:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808725888 00000100:00100000:0.0:1784045219.753493:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:0.0:1784045219.753507:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2360:x1870706808725888:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045219.753617:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2360:x1870706808725888:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 111us (9218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045219.753625:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 202 00010000:00010000:2.0:1784045220.066029:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045221.089039:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045222.118477:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045222.305843:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829729920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045222.305912:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.306339:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829729920 00000100:00100000:1.0:1784045222.306349:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829729920 00000100:00080000:3.0:1784045222.306410:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045222.306419:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045222.306431:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829729920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045222.306472:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045222.306530:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829729920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.306537:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1784045222.310358:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdc380 x1870706829729920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045222.310380:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829729920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045223.144643:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045224.164937:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045224.355158:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829730176:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355242:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.355293:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829730688:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355322:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.355354:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784045224.355360:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829730048:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355389:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.355409:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829730560:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355431:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.355459:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829730304:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355483:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.355502:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045224.355507:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829730432:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355545:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.355596:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730176 00000100:00100000:0.0:1784045224.355604:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730176 00000100:00100000:0.0:1784045224.355647:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730560 00000100:00100000:0.0:1784045224.355650:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730560 00000100:00100000:0.0:1784045224.355668:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730304 00000100:00100000:0.0:1784045224.355671:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730304 00000100:00100000:0.0:1784045224.355685:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045224.355693:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829730176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355753:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829730176:12345-0@lo:400:kworker.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.355762:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045224.355780:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045224.355786:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829730560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355815:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829730560:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.355821:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045224.355854:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045224.355874:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829730304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.355908:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829730304:12345-0@lo:400:kworker.0 Request processed in 48us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.355914:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045224.355934:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730688 00000100:00100000:0.0:1784045224.355937:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730688 00000100:00100000:0.0:1784045224.355962:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730432 00000100:00100000:0.0:1784045224.355965:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730432 00000100:00100000:0.0:1784045224.355983:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045224.355989:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829730688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.356017:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829730688:12345-0@lo:400:kworker.0 Request processed in 29us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.356023:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045224.356033:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045224.356038:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829730432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.356062:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829730432:12345-0@lo:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.356077:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1784045224.356127:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd08700 x1870706829730432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045224.356140:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829730432:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.356151:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829730304:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.356182:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829730560:0@lo:400:kworker.0 00000100:00100000:0.0:1784045224.356191:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829730176:0@lo:400:kworker.0 00010000:00080000:0.0:1784045224.356199:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937741180 x1870706829730688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045224.356207:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829730688:0@lo:400:kworker.0 00000100:00100000:2.0:1784045224.356635:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730048 00000100:00100000:2.0:1784045224.356640:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730048 00000100:00100000:2.0:1784045224.356672:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784045224.356678:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829730048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045224.356723:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829730048:12345-0@lo:400:kworker.0 Request processed in 45us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045224.356739:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784045224.356782:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829730048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045224.357296:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045224.357307:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829730816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045224.357353:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045224.357392:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730816 00000100:00100000:1.0:1784045224.357396:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730816 00000100:00100000:1.0:1784045224.357426:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784045224.357432:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829730816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045224.357494:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045224.357538:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829730816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045224.357543:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1784045224.357600:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdc380 x1870706829730816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045224.357615:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829730816:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784045224.358069:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045224.358075:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045224.358078:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045224.863536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045224.863597:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045224.864144:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726272 00000100:00100000:0.0:1784045224.864156:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726272 00000100:00100000:0.0:1784045224.864219:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:0.0:1784045224.864229:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808726272:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045224.864333:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808726272:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 104us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.864340:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00080000:3.0:1784045224.864578:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045224.864698:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726144 00000100:00100000:1.0:1784045224.864703:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726144 00000100:00100000:1.0:1784045224.864734:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:1.0:1784045224.864749:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2361:x1870706808726144:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045224.864793:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2361:x1870706808726144:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 45us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045224.864800:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 204 00010000:00010000:0.0:1784045225.185698:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045226.209511:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045227.233180:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045227.425158:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829730944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045227.425281:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045227.429527:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829730944 00000100:00100000:1.0:1784045227.429543:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829730944 00000100:00100000:1.0:1784045227.429635:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784045227.429646:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829730944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045227.429687:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045227.429770:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829730944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (4489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045227.429777:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1784045227.429823:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa9082a2300 x1870706829730944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045227.429879:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829730944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784045227.430119:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045228.261388:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045229.281920:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045229.474149:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045229.474225:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045229.487471:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829731328:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.487556:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045229.487605:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045229.487611:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829731456:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.487629:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045229.487661:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731328 00000100:00100000:2.0:1784045229.487668:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731328 00000100:00100000:2.0:1784045229.487706:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731456 00000100:00100000:2.0:1784045229.487709:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731456 00000100:00100000:2.0:1784045229.487732:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784045229.487740:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829731328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.487801:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829731328:12345-0@lo:400:kworker.0 Request processed in 62us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.487808:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784045229.487823:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784045229.487856:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829731456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.487881:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829731456:12345-0@lo:400:kworker.0 Request processed in 53us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.487902:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1784045229.487926:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045229.487943:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829731584:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.487975:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045229.487999:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784045229.488005:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93face680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829731200:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488030:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045229.488051:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829731712:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488071:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045229.488094:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731200 00000100:00100000:2.0:1784045229.488097:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731200 00000100:00100000:2.0:1784045229.488123:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784045229.488129:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829731200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488162:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829731200:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.488169:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784045229.488213:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829731456:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488223:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829731328:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488244:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731712 00000100:00100000:2.0:1784045229.488247:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731712 00000100:00100000:2.0:1784045229.488267:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784045229.488272:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488299:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829731712:12345-0@lo:400:kworker.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.488305:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1784045229.488326:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045229.488341:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93face680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829731200:0@lo:400:kworker.0 00000100:00100000:2.0:1784045229.488350:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829731712:0@lo:400:kworker.0 00000100:00100000:0.0:1784045229.489398:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731584 00000100:00100000:0.0:1784045229.489405:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731584 00000100:00100000:0.0:1784045229.489471:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045229.489488:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829731584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045229.489545:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829731584:12345-0@lo:400:kworker.0 Request processed in 67us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045229.489552:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1784045229.489623:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045229.489652:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93facf800 x1870706829731584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045229.489664:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829731584:0@lo:400:kworker.0 00000100:00100000:1.0:1784045229.496008:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731072 00000100:00100000:1.0:1784045229.496023:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731072 00000100:00100000:2.0:1784045229.496196:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784045229.496208:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829731072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045229.496248:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045229.496478:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829731072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 272us (22252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.496499:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1784045229.496545:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d36d80 x1870706829731072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045229.496566:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829731072:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784045229.497952:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045229.989746:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045229.989800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045229.989904:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726400 00000100:00100000:2.0:1784045229.989917:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726400 00000100:00100000:2.0:1784045229.989990:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:2.0:1784045229.990003:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808726400:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045229.990106:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808726400:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 104us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.990115:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:2.0:1784045229.990155:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726528 00000100:00100000:2.0:1784045229.990175:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726528 00000100:00100000:2.0:1784045229.990219:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1784045229.990226:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808726528:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045229.990258:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808726528:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045229.990276:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00080000:2.0:1784045229.990404:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784045230.306079:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045231.334864:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045232.355766:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045232.546462:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829731840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045232.546537:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045232.548523:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731840 00000100:00100000:3.0:1784045232.548537:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731840 00000100:00100000:3.0:1784045232.548608:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045232.548619:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829731840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045232.548660:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045232.549296:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829731840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 677us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045232.549305:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784045232.549335:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045232.550046:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa9082a3480 x1870706829731840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045232.550069:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829731840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045233.376955:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045234.401128:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045234.593537:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829732096:0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.593606:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045234.593664:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829732608:0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.593691:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045234.593719:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045234.593725:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93face680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829732224:0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.593746:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045234.593775:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732096 00000100:00100000:2.0:1784045234.593782:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732096 00000100:00100000:2.0:1784045234.593826:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732224 00000100:00100000:2.0:1784045234.593852:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732224 00000100:00100000:2.0:1784045234.593886:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045234.593894:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829732096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.593943:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829732096:12345-0@lo:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045234.593950:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045234.593967:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045234.593973:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829732224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.594012:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829732224:12345-0@lo:400:kworker.0 Request processed in 40us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045234.594017:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045234.594059:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93face680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829732224:0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.594068:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829732096:0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594174:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829732352:0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594204:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045234.594252:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784045234.594258:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829731968:0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594282:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045234.594302:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829732480:0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594321:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045234.594347:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732608 00000100:00100000:0.0:1784045234.594350:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732608 00000100:00100000:0.0:1784045234.594377:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732352 00000100:00100000:0.0:1784045234.594379:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732352 00000100:00100000:0.0:1784045234.594411:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045234.594417:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829732608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594456:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829732608:12345-0@lo:400:kworker.0 Request processed in 40us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045234.594471:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045234.594485:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045234.594490:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829732352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594523:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829732352:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045234.594528:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045234.594556:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829731968 00000100:00100000:0.0:1784045234.594559:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829731968 00000100:00100000:0.0:1784045234.594583:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784045234.594590:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829731968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594618:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829731968:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045234.594623:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784045234.594667:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829731968:0@lo:400:kworker.0 00010000:00080000:0.0:1784045234.594679:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93facfb80 x1870706829732352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045234.594688:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829732352:0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594704:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732480 00000100:00100000:0.0:1784045234.594707:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732480 00000100:00100000:0.0:1784045234.594731:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784045234.594736:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829732480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045234.594769:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829732480:12345-0@lo:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045234.594775:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784045234.594810:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829732480:0@lo:400:kworker.0 00010000:00080000:0.0:1784045234.594853:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93facea00 x1870706829732608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045234.594862:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829732608:0@lo:400:kworker.0 00000100:00100000:2.0:1784045234.596334:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045234.596353:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829732736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045234.596416:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045234.596564:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732736 00000100:00100000:1.0:1784045234.596571:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732736 00000100:00100000:1.0:1784045234.596619:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045234.596626:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829732736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045234.596660:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045234.596710:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829732736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045234.596727:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1784045234.596800:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d34000 x1870706829732736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045234.596817:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829732736:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784045234.598449:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045234.598458:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045234.598461:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045235.110660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045235.110710:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045235.110805:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726656 00000100:00100000:3.0:1784045235.110820:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726656 00000100:00100000:3.0:1784045235.110929:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 208 00000100:00100000:3.0:1784045235.110942:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2360:x1870706808726656:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045235.111114:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2360:x1870706808726656:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 173us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045235.111124:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 208 00000100:00100000:3.0:1784045235.112727:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726784 00000100:00100000:3.0:1784045235.112740:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726784 00000100:00100000:3.0:1784045235.112818:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1784045235.112842:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808726784:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045235.112920:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808726784:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045235.112927:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00080000:3.0:1784045235.112948:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784045235.427376:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045235.590144:0:9982:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:07:14 (1784045234) === 00000100:00100000:3.0:1784045236.041599:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045236.041695:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808726912 00000100:00100000:0.0:1784045236.041709:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808726912 00000100:00100000:0.0:1784045236.041787:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:0.0:1784045236.041799:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:8106:x1870706808726912:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045236.041885:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045236.041917:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e33400/0xdb5b5ff6a2d2cd84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffc97 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.041956:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e33400/0xdb5b5ff6a2d2cd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc97 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.041968:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e33400/0xdb5b5ff6a2d2cd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc97 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.041978:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33400, rc 0) 00000100:00100000:0.0:1784045236.042048:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8106:x1870706808726912:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 252us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045236.042056:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:2.0:1784045236.047680:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045236.047925:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727040 00000100:00100000:1.0:1784045236.047939:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727040 00000100:00100000:1.0:1784045236.048026:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:1.0:1784045236.048041:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8106:x1870706808727040:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784045236.051681:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8106:x1870706808727040:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 3632us (4005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045236.051706:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:1.0:1784045236.060650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045236.060968:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727168 00000100:00100000:3.0:1784045236.060977:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727168 00000100:00100000:3.0:1784045236.062532:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:3.0:1784045236.062552:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8106:x1870706808727168:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784045236.062855:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8106:x1870706808727168:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 309us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045236.062864:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:3.0:1784045236.069394:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045236.069549:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727296 00000100:00100000:1.0:1784045236.069566:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727296 00000100:00100000:1.0:1784045236.069640:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:1.0:1784045236.069651:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8110:x1870706808727296:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045236.070320:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8110:x1870706808727296:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 669us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045236.070328:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:2.0:1784045236.111949:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045236.112983:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727424 00000100:00100000:3.0:1784045236.112997:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727424 00000100:00100000:2.0:1784045236.113150:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:2.0:1784045236.113160:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8110:x1870706808727424:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045236.113547:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8110:x1870706808727424:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 388us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045236.113556:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:2.0:1784045236.127956:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045236.128130:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727552 00000100:00100000:0.0:1784045236.128140:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727552 00000100:00100000:0.0:1784045236.128212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:0.0:1784045236.128222:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:8106:x1870706808727552:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045236.128238:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045236.128256:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2cd8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffcc1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.128286:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2cd8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc1 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.128297:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2cd8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc1 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.128306:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33000, rc 0) 00000100:00100000:0.0:1784045236.128383:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:8106:x1870706808727552:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 162us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045236.128391:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:3.0:1784045236.137590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045236.137728:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727680 00000100:00100000:1.0:1784045236.137742:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727680 00000100:00100000:1.0:1784045236.137819:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:1.0:1784045236.137876:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:8106:x1870706808727680:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784045236.137914:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784045236.137947:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784045236.137951:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784045236.137961:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784045236.137964:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784045236.142524:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:8106:x1870706808727680:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 4674us (4929us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045236.142545:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:2.0:1784045236.146744:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045236.146982:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727808 00000100:00100000:0.0:1784045236.146995:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727808 00000100:00100000:0.0:1784045236.147071:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:0.0:1784045236.147083:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:8106:x1870706808727808:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045236.147104:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045236.147141:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffcc8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.147185:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.147221:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045236.147232:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32400, rc 0) 00000100:00100000:0.0:1784045236.147319:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8106:x1870706808727808:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 238us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045236.147327:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:3.0:1784045236.149891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045236.151222:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808727936 00000100:00100000:1.0:1784045236.151242:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808727936 00000100:00100000:1.0:1784045236.151345:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:1.0:1784045236.151359:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8106:x1870706808727936:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784045236.151796:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8106:x1870706808727936:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 434us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045236.151806:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:3.0:1784045236.154822:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045236.155417:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728064 00000100:00100000:2.0:1784045236.155433:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728064 00000100:00100000:2.0:1784045236.155560:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:2.0:1784045236.155573:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8106:x1870706808728064:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784045236.155944:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8106:x1870706808728064:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 372us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045236.155965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:1.0:1784045236.160397:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045236.160652:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728192 00000100:00100000:2.0:1784045236.160666:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728192 00000100:00100000:2.0:1784045236.160745:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:2.0:1784045236.160759:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8115:x1870706808728192:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045236.161582:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8115:x1870706808728192:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 820us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045236.161594:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:3.0:1784045236.167884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045236.168607:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728320 00000100:00100000:0.0:1784045236.168621:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728320 00000100:00100000:0.0:1784045236.168705:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:0.0:1784045236.168718:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8115:x1870706808728320:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045236.171018:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:8115:x1870706808728320:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 2286us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045236.171038:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:3.0:1784045236.177152:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045236.177222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045236.177408:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728448 00000100:00100000:2.0:1784045236.177422:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728448 00000100:00100000:2.0:1784045236.177476:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728832 00000100:00100000:2.0:1784045236.177479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728832 00000100:00100000:2.0:1784045236.177520:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1784045236.177531:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808728832:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045236.177633:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808728832:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 103us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045236.177642:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1784045236.177663:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1784045236.177667:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1870706808728448:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784045236.177695:0:5804:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1304b9c6-2799-4632-8cb2-8b086c3762a0@192.168.201.58@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1784045236.177741:0:5804:0:(genops.c:1406:class_connect()) connect: client 1304b9c6-2799-4632-8cb2-8b086c3762a0, cookie 0xdb5b5ff6a2d2cd99 00000004:00100000:2.0:1784045236.177783:0:5804:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784045236.179796:0:5804:0:(import.c:65:import_set_state_nolock()) ffff8aa93a1e8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045236.180595:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2359:x1870706808728448:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 2919us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045236.180620:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784045236.182937:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045236.183093:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728576 00000100:00100000:1.0:1784045236.183104:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728576 00000100:00100000:1.0:1784045236.183219:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045236.183230:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:0:x1870706808728576:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784045236.183276:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784045236.183387:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:0:x1870706808728576:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 159us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045236.183394:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00080000:3.0:1784045236.184468:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045236.184536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045236.184616:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728704 00000100:00100000:3.0:1784045236.184622:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728704 00000100:00100000:3.0:1784045236.184748:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784045236.184758:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:8106:x1870706808728704:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784045236.184780:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784045236.184890:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:8106:x1870706808728704:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 133us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045236.184898:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784045236.189708:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045236.190022:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808728960 00000100:00100000:1.0:1784045236.190032:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808728960 00000100:00100000:1.0:1784045236.190132:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784045236.190143:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:8106:x1870706808728960:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784045236.190240:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93face300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:8106:x1870706808728960:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 98us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045236.190259:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1784045236.195742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045236.195881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045236.196248:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729088 00000100:00100000:2.0:1784045236.196258:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729088 00000100:00100000:2.0:1784045236.196303:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729216 00000100:00100000:2.0:1784045236.196307:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729216 00000100:00100000:2.0:1784045236.196336:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784045236.196352:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808729088:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784045236.196397:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1304b9c6-2799-4632-8cb2-8b086c3762a0@192.168.201.58@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:2.0:1784045236.196429:0:6599:0:(genops.c:1406:class_connect()) connect: client 1304b9c6-2799-4632-8cb2-8b086c3762a0, cookie 0xdb5b5ff6a2d2cda0 00002000:00100000:2.0:1784045236.196441:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1304b9c6-2799-4632-8cb2-8b086c3762a0/ffff8aa93a1ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784045236.196465:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784045236.196851:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784045236.196858:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1870706808729216:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784045236.196877:0:6598:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1304b9c6-2799-4632-8cb2-8b086c3762a0@192.168.201.58@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1784045236.196896:0:6598:0:(genops.c:1406:class_connect()) connect: client 1304b9c6-2799-4632-8cb2-8b086c3762a0, cookie 0xdb5b5ff6a2d2cda7 00002000:00100000:3.0:1784045236.196902:0:6598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1304b9c6-2799-4632-8cb2-8b086c3762a0/ffff8aa92ceb3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784045236.196909:0:6598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784045236.197102:0:6598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784045236.197133:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8aa92ceb6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045236.197320:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2359:x1870706808729216:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 458us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045236.197330:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00002000:00080000:2.0:1784045236.197592:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784045236.197608:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa93a1ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045236.197634:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2359:x1870706808729088:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 1282us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045236.197641:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784045236.201513:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045236.201638:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729344 00000100:00100000:0.0:1784045236.201648:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729344 00000100:00100000:0.0:1784045236.201799:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784045236.201811:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:8106:x1870706808729344:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784045236.202143:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784045236.202417:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:8106:x1870706808729344:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 607us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045236.202425:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00010000:00010000:3.0:1784045236.451043:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045237.484475:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045237.665477:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829732864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045237.665552:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045237.665659:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732864 00000100:00100000:2.0:1784045237.665667:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732864 00000100:00100000:2.0:1784045237.665732:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784045237.665743:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829732864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045237.665777:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784045237.665899:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045237.666691:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829732864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 946us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045237.666707:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1784045237.669890:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa9082a0e00 x1870706829732864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045237.669918:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829732864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045238.499610:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784045239.248733:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1304b9c6-2799-4632-8cb2-8b086c3762a0 00000001:00100000:2.0:1784045239.317442:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1304b9c6-2799-4632-8cb2-8b086c3762a0 00010000:00010000:0.0:1784045239.522571:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045239.713314:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829732992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045239.713398:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045239.713812:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829732992 00000100:00100000:2.0:1784045239.713822:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829732992 00000100:00100000:2.0:1784045239.713919:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784045239.713930:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829732992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045239.713983:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045239.714046:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829732992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045239.714055:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1784045239.714122:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784045239.714232:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d35880 x1870706829732992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045239.714251:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829732992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045239.714729:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045239.714792:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045239.714806:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829733248:0@lo:400:kworker.0 00000100:00100000:0.0:1784045239.714916:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045239.715776:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733248 00000100:00100000:1.0:1784045239.715785:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733248 00000100:00100000:1.0:1784045239.715867:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784045239.715877:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829733248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045239.715946:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829733248:12345-0@lo:400:kworker.0 Request processed in 59us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045239.715953:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784045239.715994:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829733248:0@lo:400:kworker.0 00000100:00100000:3.0:1784045239.716146:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829733120:0@lo:400:kworker.0 00000100:00100000:3.0:1784045239.716186:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045239.716562:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829733376:0@lo:400:kworker.0 00000100:00100000:3.0:1784045239.716588:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045239.716678:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733376 00000100:00100000:1.0:1784045239.716683:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733376 00000100:00100000:1.0:1784045239.716716:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784045239.716722:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829733376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045239.716800:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829733632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045239.716824:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045239.716865:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733632 00000100:00100000:2.0:1784045239.716868:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733632 00000100:00100000:2.0:1784045239.716889:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784045239.716894:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829733632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045239.716922:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829733632:12345-0@lo:400:kworker.0 Request processed in 28us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045239.716928:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784045239.716971:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93faced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829733632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045239.716987:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829733504:0@lo:400:kworker.0 00000100:00100000:2.0:1784045239.717010:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045239.717140:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829733376:12345-0@lo:400:kworker.0 Request processed in 417us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045239.717147:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784045239.717208:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829733376:0@lo:400:kworker.0 00000100:00100000:3.0:1784045239.717226:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733504 00000100:00100000:3.0:1784045239.717228:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733504 00000100:00100000:3.0:1784045239.717416:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045239.717424:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829733504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045239.717498:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93faced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829733504:12345-0@lo:400:kworker.0 Request processed in 75us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045239.717504:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784045239.717556:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045239.717561:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784045239.717606:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93facf800 x1870706829733504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045239.717617:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829733504:0@lo:400:kworker.0 00000100:00100000:0.0:1784045239.717675:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733120 00000100:00100000:0.0:1784045239.717678:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733120 00000100:00100000:0.0:1784045239.717706:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1784045239.717712:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829733120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045239.717751:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829733120:12345-0@lo:400:kworker.0 Request processed in 39us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045239.717757:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784045239.717763:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829733120:0@lo:400:kworker.0 00000001:00100000:1.0:1784045240.284727:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1304b9c6-2799-4632-8cb2-8b086c3762a0 00010000:00010000:2.0:1784045240.547873:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045241.249423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045241.249469:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045241.249497:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045241.249524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045241.249548:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045241.249588:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729728 00000100:00100000:1.0:1784045241.249597:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729728 00000100:00100000:3.0:1784045241.249627:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729984 00000100:00100000:3.0:1784045241.249641:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729984 00000100:00100000:1.0:1784045241.249661:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729600 00000100:00100000:1.0:1784045241.249667:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729600 00000100:00100000:1.0:1784045241.249700:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:1.0:1784045241.249708:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808729728:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045241.249776:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808729728:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045241.249783:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:1.0:1784045241.249797:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784045241.249803:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808729600:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045241.249825:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808729600:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045241.249854:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:3.0:1784045241.249935:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729856 00000100:00100000:3.0:1784045241.249942:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729856 00000100:00100000:0.0:1784045241.249946:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808729472 00000100:00100000:0.0:1784045241.249953:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808729472 00000100:00100000:0.0:1784045241.250070:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:0.0:1784045241.250077:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808729472:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045241.250102:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808729472:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045241.250118:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00080000:0.0:1784045241.250161:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045241.250165:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045241.250168:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045241.250491:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1784045241.250501:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808729984:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045241.250543:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808729984:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 43us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045241.250549:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1784045241.250563:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:1.0:1784045241.250569:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808729856:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045241.250589:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808729856:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045241.250595:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00010000:00010000:0.0:1784045241.569019:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784045242.548924:0:10179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1784045242.593149:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045242.794207:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045242.794233:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829733760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045242.794312:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.795691:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733760 00000100:00100000:0.0:1784045242.795704:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733760 00000100:00100000:0.0:1784045242.795771:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045242.795781:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829733760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045242.795819:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045242.795907:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829733760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.795914:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1784045242.795934:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045242.795965:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93facea00 x1870706829733760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045242.795986:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829733760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784045243.621433:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045244.641083:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045244.834105:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829734016:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834169:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.834210:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829734528:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834244:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.834275:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784045244.834282:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829733888:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834307:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.834337:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829734400:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834360:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.834385:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829734144:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834407:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.834425:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045244.834430:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829734272:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834452:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.834480:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734016 00000100:00100000:0.0:1784045244.834487:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734016 00000100:00100000:0.0:1784045244.834529:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734400 00000100:00100000:0.0:1784045244.834532:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734400 00000100:00100000:0.0:1784045244.834553:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734144 00000100:00100000:0.0:1784045244.834556:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734144 00000100:00100000:0.0:1784045244.834573:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784045244.834581:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829734016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834630:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829734016:12345-0@lo:400:kworker.0 Request processed in 49us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.834637:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784045244.834652:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045244.834659:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829734400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834685:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829734400:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.834691:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045244.834703:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045244.834709:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829734144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834740:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829734144:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.834755:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045244.834772:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734528 00000100:00100000:0.0:1784045244.834776:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734528 00000100:00100000:0.0:1784045244.834801:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734272 00000100:00100000:0.0:1784045244.834804:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734272 00000100:00100000:0.0:1784045244.834824:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045244.834875:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829734528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834909:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829734528:12345-0@lo:400:kworker.0 Request processed in 78us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.834915:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045244.834926:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045244.834932:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829734272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.834959:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829734272:12345-0@lo:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.834965:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045244.834983:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829733888 00000100:00100000:0.0:1784045244.834986:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829733888 00000100:00100000:0.0:1784045244.835009:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784045244.835015:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829733888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.835042:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829733888:12345-0@lo:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.835048:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1784045244.835084:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045244.835088:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045244.835091:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045244.835133:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045244.835142:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829734656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045244.835173:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045244.835198:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734656 00000100:00100000:0.0:1784045244.835202:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734656 00000100:00100000:0.0:1784045244.835239:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784045244.835245:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829734656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045244.835273:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045244.835307:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829734656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045244.835312:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1784045244.835345:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937741180 x1870706829734656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045244.835366:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829734656:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784045244.835394:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d32300 x1870706829734272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045244.835403:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829734272:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.835413:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829734144:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.835437:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829733888:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.835446:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829734400:0@lo:400:kworker.0 00000100:00100000:0.0:1784045244.835456:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829734016:0@lo:400:kworker.0 00010000:00080000:0.0:1784045244.835464:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d33480 x1870706829734528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045244.835473:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829734528:0@lo:400:kworker.0 00010000:00010000:3.0:1784045245.668099:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045246.371607:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045246.371646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045246.371746:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730112 00000100:00100000:0.0:1784045246.371756:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730112 00000100:00100000:0.0:1784045246.371816:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:0.0:1784045246.371848:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808730112:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045246.371927:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808730112:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045246.371935:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:1.0:1784045246.374340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045246.374364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045246.374419:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730624 00000100:00100000:0.0:1784045246.374426:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730624 00000100:00080000:3.0:1784045246.374481:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045246.374490:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784045246.374500:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808730624:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045246.374563:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808730624:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045246.374570:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:2.0:1784045246.376515:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730368 00000100:00100000:2.0:1784045246.376528:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730368 00000100:00100000:1.0:1784045246.376651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045246.376714:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730240 00000100:00100000:0.0:1784045246.376719:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730240 00000100:00100000:0.0:1784045246.376768:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1784045246.376778:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808730368:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045246.376865:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808730368:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 88us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045246.376873:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1784045246.376891:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:0.0:1784045246.376898:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808730240:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045246.376924:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808730240:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045246.376944:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:0.0:1784045246.376965:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730496 00000100:00100000:0.0:1784045246.376969:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730496 00000100:00100000:0.0:1784045246.376997:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:0.0:1784045246.377003:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808730496:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045246.377029:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808730496:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045246.377035:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00080000:3.0:1784045246.377130:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045246.377135:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784045246.688968:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045247.713111:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045247.906416:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829734784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045247.906498:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045247.906699:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734784 00000100:00100000:2.0:1784045247.906719:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734784 00000100:00100000:2.0:1784045247.906789:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784045247.906799:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829734784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045247.906856:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045247.906908:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829734784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045247.906915:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1784045247.906957:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93facf800 x1870706829734784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045247.907188:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829734784:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784045247.907389:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045248.737198:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045249.761750:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045249.955033:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045249.955057:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829734912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045249.955124:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045249.955199:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829734912 00000100:00100000:0.0:1784045249.955207:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829734912 00000100:00100000:0.0:1784045249.955267:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045249.955277:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829734912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045249.955316:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045249.955363:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829734912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045249.955371:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1784045249.955390:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784045249.955420:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0a680 x1870706829734912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045249.955438:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829734912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045249.955617:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045249.955627:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829735168:0@lo:400:kworker.0 00000100:00100000:2.0:1784045249.955663:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045249.955720:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829735296:0@lo:400:kworker.0 00000100:00100000:2.0:1784045249.955747:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045249.955776:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735168 00000100:00100000:2.0:1784045249.955781:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735168 00000100:00100000:2.0:1784045249.955808:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735296 00000100:00100000:2.0:1784045249.955811:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735296 00000100:00100000:2.0:1784045249.955861:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784045249.955868:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829735168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045249.955905:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829735168:12345-0@lo:400:kworker.0 Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045249.955913:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784045249.955947:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784045249.955954:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045249.955983:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829735296:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045249.955989:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784045249.956018:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829735296:0@lo:400:kworker.0 00000100:00100000:2.0:1784045249.956027:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829735168:0@lo:400:kworker.0 00000100:00100000:3.0:1784045249.956190:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829735424:0@lo:400:kworker.0 00000100:00100000:3.0:1784045249.956226:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045249.956252:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784045249.956258:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829735040:0@lo:400:kworker.0 00000100:00100000:3.0:1784045249.956285:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045249.956303:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829735552:0@lo:400:kworker.0 00000100:00100000:3.0:1784045249.956321:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045249.956344:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735552 00000100:00100000:3.0:1784045249.956347:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735552 00000100:00100000:3.0:1784045249.956375:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784045249.956381:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829735552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045249.956415:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829735552:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045249.956421:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784045249.956456:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829735552:0@lo:400:kworker.0 00000100:00100000:0.0:1784045249.956946:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735424 00000100:00100000:0.0:1784045249.956951:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735424 00000100:00100000:0.0:1784045249.956994:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045249.957002:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829735424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045249.957050:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829735424:12345-0@lo:400:kworker.0 Request processed in 50us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045249.957056:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045249.957075:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735040 00000100:00100000:0.0:1784045249.957078:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735040 00000100:00100000:0.0:1784045249.957102:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784045249.957108:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829735040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045249.957148:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829735040:12345-0@lo:400:kworker.0 Request processed in 41us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045249.957155:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1784045249.957181:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045249.957185:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045249.957204:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829735040:0@lo:400:kworker.0 00010000:00080000:0.0:1784045249.957216:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd16d80 x1870706829735424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045249.957225:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829735424:0@lo:400:kworker.0 00010000:00010000:0.0:1784045250.785930:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045251.492051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045251.492113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045251.492148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045251.492190:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045251.492222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045251.492248:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731008 00000100:00100000:3.0:1784045251.492263:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731008 00000100:00100000:3.0:1784045251.492316:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730880 00000100:00100000:3.0:1784045251.492319:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730880 00000100:00100000:3.0:1784045251.492347:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1784045251.492357:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731008:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045251.492433:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731008:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045251.492440:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1784045251.492455:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784045251.492462:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808730880:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045251.492483:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808730880:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045251.492489:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:0.0:1784045251.492599:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808730752 00000100:00100000:0.0:1784045251.492603:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808730752 00000100:00100000:0.0:1784045251.492672:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00080000:1.0:1784045251.492675:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045251.492684:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808730752:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045251.492690:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731264 00000100:00100000:1.0:1784045251.492695:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731264 00000100:00100000:0.0:1784045251.492723:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808730752:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 44us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045251.492735:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:0.0:1784045251.495169:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731136 00000100:00100000:0.0:1784045251.495181:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731136 00000100:00100000:1.0:1784045251.495209:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:1.0:1784045251.495223:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731264:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045251.495300:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731264:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 80us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045251.509381:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:0.0:1784045251.509420:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731136:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045251.509509:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731136:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 114us (17287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045251.509518:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00080000:0.0:1784045251.511178:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045251.511188:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045251.512218:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00010000:00010000:3.0:1784045251.811435:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045252.842129:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045253.025736:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045253.025763:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829735680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045253.025899:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045253.026251:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735680 00000100:00100000:1.0:1784045253.026260:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735680 00000100:00100000:1.0:1784045253.026372:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045253.026383:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829735680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045253.026417:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045253.026469:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829735680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045253.026755:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1784045253.026815:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d7800 x1870706829735680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045253.026856:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829735680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784045253.027003:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045253.865920:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045254.885323:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045255.073549:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829735808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045255.073741:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.073863:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735808 00000100:00100000:1.0:1784045255.073872:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735808 00000100:00100000:1.0:1784045255.073948:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045255.073957:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829735808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045255.073991:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045255.074061:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829735808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.074069:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1784045255.074136:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784045255.075988:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0a680 x1870706829735808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045255.076016:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829735808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045255.076135:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829736320:0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.076136:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829735936:0@lo:400:kworker.0 00000100:00100000:1.0:1784045255.076222:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.076323:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045255.076331:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829736192:0@lo:400:kworker.0 00000100:00100000:1.0:1784045255.076428:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.076765:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.076797:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829736448:0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.076822:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.076878:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045255.076884:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829736064:0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.076906:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.076939:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736192 00000100:00100000:3.0:1784045255.076951:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736192 00000100:00100000:3.0:1784045255.076997:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736448 00000100:00100000:3.0:1784045255.077000:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736448 00000100:00100000:3.0:1784045255.077012:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736064 00000100:00100000:3.0:1784045255.077015:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736064 00000100:00100000:3.0:1784045255.077027:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784045255.077034:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829736192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.077095:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829736192:12345-0@lo:400:kworker.0 Request processed in 60us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.077102:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784045255.077118:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784045255.077124:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829736448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045255.077143:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736320 00000100:00100000:2.0:1784045255.077147:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736320 00000100:00100000:3.0:1784045255.077167:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829736448:12345-0@lo:400:kworker.0 Request processed in 43us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.077173:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784045255.077175:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784045255.077181:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829736320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.077183:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784045255.077187:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829736064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.077211:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829736064:12345-0@lo:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045255.077211:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829736320:12345-0@lo:400:kworker.0 Request processed in 30us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.077217:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045255.077217:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045255.077256:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829736192:0@lo:400:kworker.0 00010000:00080000:3.0:1784045255.077269:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d4e00 x1870706829736320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.077278:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829736320:0@lo:400:kworker.0 00000100:00080000:3.0:1784045255.077302:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045255.077306:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045255.077326:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829736064:0@lo:400:kworker.0 00000100:00100000:3.0:1784045255.077335:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829736448:0@lo:400:kworker.0 00000100:00100000:0.0:1784045255.078356:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829735936 00000100:00100000:0.0:1784045255.078364:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829735936 00000100:00100000:0.0:1784045255.078427:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784045255.078437:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829735936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045255.078516:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829735936:12345-0@lo:400:kworker.0 Request processed in 81us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.078523:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784045255.078779:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829735936:0@lo:400:kworker.0 00010000:00010000:2.0:1784045255.904954:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045256.607474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045256.607519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045256.607618:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731520 00000100:00100000:1.0:1784045256.607627:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731520 00000100:00080000:2.0:1784045256.607698:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045256.607711:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1784045256.607723:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808731520:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045256.607813:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808731520:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045256.607822:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1784045256.608199:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731392 00000100:00100000:3.0:1784045256.608204:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731392 00000100:00100000:3.0:1784045256.608244:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:3.0:1784045256.608251:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808731392:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045256.608289:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808731392:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 38us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045256.608296:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:2.0:1784045256.612155:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045256.612203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045256.612279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045256.612310:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731648 00000100:00100000:2.0:1784045256.612319:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731648 00000100:00100000:2.0:1784045256.612385:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:2.0:1784045256.612394:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731648:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045256.612462:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808731648:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045256.612470:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00080000:2.0:1784045256.612494:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045256.614497:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731776 00000100:00100000:1.0:1784045256.614508:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731776 00000100:00100000:1.0:1784045256.614927:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808731904 00000100:00100000:1.0:1784045256.614931:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808731904 00000100:00100000:1.0:1784045256.614958:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784045256.614965:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2359:x1870706808731776:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:1.0:1784045256.614989:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cda0 00000100:00080000:1.0:1784045256.614995:0:6600:0:(import.c:65:import_set_state_nolock()) ffff8aa93a1ed800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784045256.615040:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784045256.615156:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:3.0:1784045256.615166:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2359:x1870706808731904:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:3.0:1784045256.615178:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cda7 00000100:00080000:3.0:1784045256.615260:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8aa92ceb6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784045256.615284:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784045256.615381:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+2:2359:x1870706808731776:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 415us (3236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045256.615388:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:1.0:1784045256.615423:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045256.615431:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045256.615434:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045256.615467:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+2:2359:x1870706808731904:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 302us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045256.615473:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:2.0:1784045256.615821:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045256.931409:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045257.953267:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045258.150523:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045258.150626:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829736576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045258.150727:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045258.150792:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736576 00000100:00100000:0.0:1784045258.150809:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736576 00000100:00100000:0.0:1784045258.150904:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045258.150932:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829736576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045258.150973:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784045258.150981:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045258.151072:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829736576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045258.151092:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1784045258.151233:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d6d80 x1870706829736576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045258.151261:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829736576:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784045258.886356:0:10881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784045258.978170:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784045259.742883:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1304b9c6-2799-4632-8cb2-8b086c3762a0 00000020:00000080:2.0:1784045259.742895:0:7510:0:(genops.c:906:class_export_put()) final put ffff8aa92ceb3000/1304b9c6-2799-4632-8cb2-8b086c3762a0 00000020:00000080:1.0:1784045259.744464:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa92ceb3000/1304b9c6-2799-4632-8cb2-8b086c3762a0 for lustre-OST0001 00000020:00000080:1.0:1784045259.745691:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa92ceb6000 for lustre-OST0001 00010000:00010000:2.0:1784045260.001199:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045260.193520:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829736704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045260.193592:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045260.193671:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736704 00000100:00100000:0.0:1784045260.193680:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736704 00000100:00100000:0.0:1784045260.193736:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784045260.193759:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829736704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045260.193796:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045260.193857:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829736704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045260.193864:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1784045260.193884:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784045260.193916:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0b800 x1870706829736704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045260.193933:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829736704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045260.194795:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829736960:0@lo:400:kworker.0 00000100:00100000:1.0:1784045260.194927:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.194954:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045260.194970:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829737088:0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196367:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829736832:0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196428:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.196465:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829737344:0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196489:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.196516:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045260.196522:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829737216:0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196547:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.196582:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736832 00000100:00100000:3.0:1784045260.196588:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736832 00000100:00100000:3.0:1784045260.196634:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784045260.196642:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829736832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196688:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829736832:12345-0@lo:400:kworker.0 Request processed in 47us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045260.196695:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784045260.196722:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829737216 00000100:00100000:3.0:1784045260.196725:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829737216 00000100:00100000:3.0:1784045260.196780:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045260.196786:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829737216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196815:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829737216:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045260.196821:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1784045260.196875:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d37480 x1870706829737216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045260.196889:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829737216:0@lo:400:kworker.0 00000100:00100000:3.0:1784045260.196898:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829736832:0@lo:400:kworker.0 00000100:00100000:1.0:1784045260.197361:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.197407:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829736960 00000100:00100000:1.0:1784045260.197413:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829736960 00000100:00100000:1.0:1784045260.197441:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829737344 00000100:00100000:1.0:1784045260.197444:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829737344 00000100:00100000:1.0:1784045260.197460:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829737088 00000100:00100000:1.0:1784045260.197462:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829737088 00000100:00100000:1.0:1784045260.197476:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784045260.197483:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829736960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045260.197528:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829736960:12345-0@lo:400:kworker.0 Request processed in 45us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.197535:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784045260.197549:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784045260.197556:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829737344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045260.197586:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829737344:12345-0@lo:400:kworker.0 Request processed in 31us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.197593:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784045260.197604:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784045260.197610:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829737088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045260.197637:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829737088:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.197643:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784045260.197704:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829737088:0@lo:400:kworker.0 00000100:00100000:1.0:1784045260.197714:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829736960:0@lo:400:kworker.0 00000100:00080000:0.0:1784045260.198458:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045260.198465:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045260.201415:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829737344:0@lo:400:kworker.0 00000001:00100000:0.0:1784045260.754347:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1304b9c6-2799-4632-8cb2-8b086c3762a0 00000020:00000080:0.0:1784045260.754358:0:6626:0:(genops.c:906:class_export_put()) final put ffff8aa93a1ee000/1304b9c6-2799-4632-8cb2-8b086c3762a0 00000020:00000080:2.0:1784045260.754463:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93a1ee000/1304b9c6-2799-4632-8cb2-8b086c3762a0 for lustre-OST0000 00000020:00000080:2.0:1784045260.754570:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93a1ed800 for lustre-OST0000 00010000:00010000:3.0:1784045261.027147:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045261.729213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045261.729254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045261.729285:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045261.729311:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732288 00000100:00100000:2.0:1784045261.729335:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732288 00000100:00100000:2.0:1784045261.729392:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732160 00000100:00100000:2.0:1784045261.729395:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732160 00000100:00100000:2.0:1784045261.729416:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:2.0:1784045261.729425:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808732288:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045261.729508:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808732288:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045261.729515:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:2.0:1784045261.729532:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784045261.729537:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808732160:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045261.729577:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808732160:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045261.729583:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00080000:2.0:1784045261.729600:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045261.729752:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732032 00000100:00100000:1.0:1784045261.729756:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732032 00000100:00100000:1.0:1784045261.729808:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:1.0:1784045261.729816:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808732032:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045261.729876:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808732032:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 62us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045261.729883:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 230 00010000:00010000:3.0:1784045262.049026:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784045262.802701:0:11030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9e160e50 20000000:00000080:2.0:1784045262.802720:0:11030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa93fc27000 uarg=0000000000000000 20000000:01000000:2.0:1784045262.802760:0:11030:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784045262.802766:0:11030:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784045262.802771:0:11030:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784045262.804292:0:11031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1784045262.804528:0:11030:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784045262.809804:0:11030:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784045262.810931:0:11030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.810961:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.810993:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811001:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811010:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811017:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811025:0:11030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811080:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811100:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 12 pid: 5796 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045262.811119:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737472:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045262.811257:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811266:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 12 pid: 5799 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045262.811275:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737600:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045262.811311:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811319:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 18 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045262.811329:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737728:0@lo:104: 00000100:00100000:0.0:1784045262.811378:0:11030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045262.811440:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829737728 00000100:00100000:0.0:1784045262.811450:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829737728 00000100:00100000:0.0:1784045262.811543:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045262.811555:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11030:x1870706829737728:12345-0@lo:104: 00010000:00010000:0.0:1784045262.811571:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811638:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045262.811644:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11030:x1870706829737728:12345-0@lo:104: Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045262.811651:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1784045262.811701:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811710:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 18 pid: 5797 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045262.811719:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737856:0@lo:104: 00000100:00100000:0.0:1784045262.811742:0:11030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045262.811761:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829737856 00000100:00100000:0.0:1784045262.811765:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829737856 00000100:00100000:0.0:1784045262.811790:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045262.811796:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11030:x1870706829737856:12345-0@lo:104: 00010000:00010000:0.0:1784045262.811805:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811886:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784045262.811892:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11030:x1870706829737856:12345-0@lo:104: Request processed in 97us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045262.811898:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1784045262.811942:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.811952:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045262.811960:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737984:0@lo:104: 00000100:00100000:0.0:1784045262.811984:0:11030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045262.812003:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829737984 00000100:00100000:0.0:1784045262.812006:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829737984 00000100:00100000:0.0:1784045262.812025:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045262.812032:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11030:x1870706829737984:12345-0@lo:104: 00010000:00010000:0.0:1784045262.812040:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.812069:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784045262.812073:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11030:x1870706829737984:12345-0@lo:104: Request processed in 43us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045262.812079:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045262.812101:0:11030:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045262.812137:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d33800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737728:0@lo:104: 00000100:00100000:0.0:1784045262.812146:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737856:0@lo:104: 00000100:00100000:0.0:1784045262.812153:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737984:0@lo:104: 00010000:00010000:0.0:1784045262.814960:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784045262.814978:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.814992:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045262.814998:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.815010:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045262.815018:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045262.815024:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045262.815151:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.815157:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045262.815184:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.815190:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173600/0xdb5b5ff6a2d2cd6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd76 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.815204:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045262.815208:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.815225:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045262.815228:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.815234:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045262.815241:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045262.815246:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1784045262.815361:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829738112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045262.815466:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045262.815547:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738112 00000100:00100000:1.0:1784045262.815557:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738112 00010000:00010000:1.0:1784045262.815596:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 19 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045262.815637:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045262.815650:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907eea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829738112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045262.815671:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045262.815679:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 19 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816000:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816009:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045262.816023:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816029:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa92d361a00/0xdb5b5ff6a2d2cd61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd68 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816040:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045262.816044:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816050:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045262.816054:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816078:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045262.816084:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045262.816090:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045262.816105:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816111:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045262.816206:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816214:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937721c00/0xdb5b5ff6a2d2cd53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cd5a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.816229:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045262.816231:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045262.816232:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045262.816241:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045262.816262:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829738368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045262.816304:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045262.816401:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 19 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.816420:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cd76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd6f expref: 19 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.816438:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045262.816473:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907eea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:3320:x1870706829738112:12345-0@lo:103:ldlm_bl.0 Request processed in 826us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045262.816482:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045262.816551:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738368 00000100:00100000:1.0:1784045262.816556:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738368 00010000:00010000:1.0:1784045262.816575:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045262.816645:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045262.816654:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:3318:x1870706829738368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045262.816665:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045262.816669:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.816678:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.816699:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031600/0xdb5b5ff6a2d2cd5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd53 expref: 18 pid: 5796 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.816710:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045262.816740:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:3318:x1870706829738368:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045262.816746:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045262.818046:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829738240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045262.818129:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045262.818215:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738240 00000100:00100000:0.0:1784045262.818224:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738240 00010000:00010000:0.0:1784045262.818282:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 17 pid: 5797 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045262.818324:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045262.818345:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:3321:x1870706829738240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045262.818363:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045262.818370:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 17 pid: 5797 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.818382:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 17 pid: 5797 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.818401:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2cd68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cd61 expref: 17 pid: 5797 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.818419:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045262.818458:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3321:x1870706829738240:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045262.818465:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045262.818961:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829738240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045262.819952:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829738112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045262.820173:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829738368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045262.823053:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045262.823078:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737472:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045262.823093:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1870706829737600:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045262.823111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1784045262.823177:0:11030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045262.823266:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732416 00000100:00100000:3.0:1784045262.823276:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732416 00010000:00010000:3.0:1784045262.823326:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 13 pid: 5799 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045262.823330:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732544 00000100:00100000:1.0:1784045262.823334:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732544 00010000:00010000:1.0:1784045262.823354:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 14 pid: 5796 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045262.823371:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:3.0:1784045262.823381:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b5546e-953c-4b15-ba5e-c489141abaa9+14:2361:x1870706808732416:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045262.823401:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045262.823408:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 14 pid: 5799 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045262.823412:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00010000:00010000:3.0:1784045262.823419:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 14 pid: 5799 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045262.823419:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b5546e-953c-4b15-ba5e-c489141abaa9+14:2363:x1870706808732544:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045262.823441:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172400/0xdb5b5ff6a2d2cd7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc90 expref: 14 pid: 5799 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823447:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045262.823451:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 13 pid: 5796 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045262.823458:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045262.823460:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 13 pid: 5796 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823469:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2cd92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc8 expref: 13 pid: 5796 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823482:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823491:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823506:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823513:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823519:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823527:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045262.823533:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:2361:x1870706808732416:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 154us (497us total) trans 0 rc 0/0 00010000:00010000:1.0:1784045262.823534:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045262.823538:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045262.823541:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00010000:00010000:1.0:1784045262.823555:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823569:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045262.823579:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045262.823602:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:2363:x1870706808732544:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 184us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045262.823608:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00010000:00010000:0.0:1784045262.823743:0:11030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.823751:0:11030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045262.823758:0:11030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e32c00/0xdb5b5ff6a2d2cdae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045263.073055:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045263.265209:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045263.265246:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045263.265344:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045263.265627:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738496 00000100:00100000:3.0:1784045263.265638:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738496 00000100:00100000:3.0:1784045263.265721:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045263.265732:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829738496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045263.265779:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045263.265871:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829738496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045263.265879:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1784045263.265970:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045263.266010:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d4a80 x1870706829738496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045263.266036:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829738496:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045264.096991:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784045264.359585:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045264.359595:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa93f779800 from 7 10000000:01000000:1.0:1784045264.359600:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045264.359654:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045264.359669:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045264.359692:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045264.359720:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829738624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045264.359796:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045264.359872:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045264.360924:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738624 00000100:00100000:3.0:1784045264.360938:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738624 00000100:00100000:3.0:1784045264.361013:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784045264.361023:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829738624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045264.361041:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045264.361061:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cdb5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045264.361093:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045264.361106:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045264.361118:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148e000, rc 0) 00000100:00100000:3.0:1784045264.361202:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829738624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045264.361208:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784045264.361626:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829738624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045264.361646:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.361657:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045264.361732:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829738752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.361769:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045264.361798:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045264.361800:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738752 00000100:00100000:1.0:1784045264.361804:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738752 00000100:00100000:1.0:1784045264.361857:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1784045264.361865:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829738752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045264.362185:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829738752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045264.362193:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784045264.362651:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829738752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.362693:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829738880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.362735:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045264.362759:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045264.362772:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829738880 00000100:00100000:0.0:1784045264.362776:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829738880 00000100:00100000:0.0:1784045264.362814:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784045264.362821:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829738880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.363017:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829738880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.363024:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784045264.363065:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829738880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784045264.363682:0:11056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784045264.363726:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784045264.363743:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045264.363757:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.363767:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045264.363777:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045264.363780:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa907eaf000 from 7 10000000:01000000:0.0:1784045264.363782:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045264.363807:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.363815:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.363824:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045264.363881:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.363924:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045264.363946:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ec9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045264.363958:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739008 00000100:00100000:0.0:1784045264.363962:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739008 00000100:00100000:0.0:1784045264.363987:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784045264.363994:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829739008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045264.364002:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045264.364014:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cdc3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.364034:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.364049:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.364057:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:0.0:1784045264.364088:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829739008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.364093:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784045264.364127:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045264.364140:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.364149:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045264.364188:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.364211:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045264.364224:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ec9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045264.364233:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739136 00000100:00100000:3.0:1784045264.364237:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739136 00000100:00100000:3.0:1784045264.364260:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784045264.364274:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829739136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045264.364497:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829739136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045264.364505:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784045264.365652:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.365697:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.365743:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045264.365782:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9051ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045264.365802:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739264 00000100:00100000:1.0:1784045264.365807:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739264 00000100:00100000:1.0:1784045264.365859:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784045264.365868:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829739264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.367670:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829739264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1794us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.367683:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784045264.367812:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784045264.372511:0:11057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784045264.374321:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784045264.374375:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045264.374388:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045264.374403:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045264.374413:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045264.374416:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90538d800 from 7 10000000:01000000:3.0:1784045264.374419:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045264.374461:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045264.374469:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045264.374481:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045264.374512:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045264.374591:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045264.374643:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045264.374682:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739392 00000100:00100000:0.0:1784045264.374695:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739392 00000100:00100000:0.0:1784045264.374761:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784045264.374771:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829739392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045264.374785:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045264.374798:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cdd1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.374823:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.374857:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.374877:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33600, rc 0) 00000100:00100000:0.0:1784045264.374951:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829739392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.374958:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784045264.377590:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045264.377624:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045264.377636:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045264.377743:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045264.377801:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045264.377867:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045264.378042:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739520 00000100:00100000:1.0:1784045264.378049:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739520 00000100:00100000:1.0:1784045264.378089:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784045264.378098:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829739520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045264.378361:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829739520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045264.378369:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784045264.378587:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045264.378625:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045264.378664:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045264.378698:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045264.382132:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739648 00000100:00100000:0.0:1784045264.382148:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739648 00000100:00100000:0.0:1784045264.382224:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784045264.382233:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829739648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.382455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829739648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.382463:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784045264.382525:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829739648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784045264.383327:0:11058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784045264.383394:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784045264.383411:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045264.383433:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.383444:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045264.682763:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045264.682858:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732672 00000100:00100000:0.0:1784045264.682868:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732672 00000100:00100000:0.0:1784045264.682939:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:0.0:1784045264.682951:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:5579:x1870706808732672:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045264.682969:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045264.683204:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffcf2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.683234:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.683245:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045264.683254:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32a00, rc 0) 00000100:00100000:0.0:1784045264.683310:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808732672:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 362us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.683317:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:3.0:1784045264.689478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045264.689551:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732800 00000100:00100000:0.0:1784045264.689562:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732800 00000100:00100000:0.0:1784045264.689633:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:0.0:1784045264.689645:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808732800:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.693019:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808732800:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 3363us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.693036:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:2.0:1784045264.698384:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045264.698515:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808732928 00000100:00100000:0.0:1784045264.698527:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808732928 00000100:00100000:0.0:1784045264.698604:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 242 00000100:00100000:0.0:1784045264.698616:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808732928:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045264.699503:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808732928:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 883us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.699514:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 242 00000100:00100000:0.0:1784045264.712384:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045264.712643:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733056 00000100:00100000:1.0:1784045264.712654:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733056 00000100:00100000:1.0:1784045264.712728:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 243 00000100:00100000:1.0:1784045264.712739:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808733056:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045264.712758:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045264.712778:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffcf9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045264.712810:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045264.712823:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045264.712873:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360a00, rc 0) 00000100:00100000:1.0:1784045264.712944:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808733056:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 207us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045264.712952:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 243 00000100:00100000:0.0:1784045264.720798:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045264.723155:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733184 00000100:00100000:2.0:1784045264.723173:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733184 00000100:00100000:2.0:1784045264.723614:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 244 00000100:00100000:2.0:1784045264.723627:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808733184:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045264.723977:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808733184:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 352us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045264.723985:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 244 00000100:00100000:3.0:1784045264.726960:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045264.727001:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733312 00000100:00100000:3.0:1784045264.727011:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733312 00000100:00100000:3.0:1784045264.727055:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 245 00000100:00100000:3.0:1784045264.727064:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808733312:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045264.727284:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808733312:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 219us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045264.727292:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 245 00010000:00010000:0.0:1784045265.126907:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045265.317110:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829739776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045265.317356:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.317428:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829740288:0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317456:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045265.317467:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829740160:0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317487:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784045265.317494:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829739904:0@lo:400:kworker.0 00000100:00100000:0.0:1784045265.317498:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.317523:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.317557:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829740416:0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317581:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045265.317595:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784045265.317603:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829740032:0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317615:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740288 00000100:00100000:2.0:1784045265.317621:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740288 00000100:00100000:0.0:1784045265.317627:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045265.317644:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829740544:0@lo:400:kworker.0 00000100:00100000:0.0:1784045265.317660:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.317676:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784045265.317686:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829740288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317739:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829740288:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.317746:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784045265.317755:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740544 00000100:00100000:0.0:1784045265.317758:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740544 00000100:00100000:2.0:1784045265.317767:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740160 00000100:00100000:2.0:1784045265.317770:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740160 00000100:00100000:2.0:1784045265.317791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740416 00000100:00100000:0.0:1784045265.317793:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784045265.317794:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740416 00000100:00100000:0.0:1784045265.317801:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829740544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317805:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740032 00000100:00100000:2.0:1784045265.317807:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740032 00000100:00100000:2.0:1784045265.317817:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784045265.317823:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829740160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045265.317854:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829740544:12345-0@lo:400:kworker.0 Request processed in 55us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.317867:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784045265.317889:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829740160:12345-0@lo:400:kworker.0 Request processed in 65us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.317895:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784045265.317906:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784045265.317912:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829740416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.317941:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829740416:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.317947:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784045265.317958:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784045265.317964:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829740032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.318001:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829740032:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.318007:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784045265.318025:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739904 00000100:00100000:2.0:1784045265.318029:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739904 00000100:00100000:2.0:1784045265.318053:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1784045265.318059:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829739904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045265.318087:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930802850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829739904:12345-0@lo:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.318094:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1784045265.318130:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045265.318135:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045265.318137:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045265.318169:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829739904:0@lo:400:kworker.0 00010000:00080000:0.0:1784045265.318206:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93fd0a680 x1870706829740544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045265.318218:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829740544:0@lo:400:kworker.0 00000100:00100000:0.0:1784045265.318230:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829740160:0@lo:400:kworker.0 00000100:00100000:0.0:1784045265.318251:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829740032:0@lo:400:kworker.0 00000100:00100000:1.0:1784045265.318498:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829739776 00000100:00100000:1.0:1784045265.318503:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829739776 00000100:00100000:1.0:1784045265.318532:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784045265.318540:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829739776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045265.318569:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045265.318606:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829739776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045265.318612:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784045265.321844:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829740416:0@lo:400:kworker.0 00010000:00080000:2.0:1784045265.321911:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d36300 x1870706829739776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045265.321933:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829739776:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784045265.321948:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d34e00 x1870706829740288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045265.322635:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829740288:0@lo:400:kworker.0 00010000:00010000:0.0:1784045266.147652:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045266.859852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045266.859900:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045266.859936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045266.859962:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733568 00000100:00100000:1.0:1784045266.859971:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733568 00000100:00100000:1.0:1784045266.860025:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733696 00000100:00100000:1.0:1784045266.860029:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733696 00000100:00100000:1.0:1784045266.860055:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:1.0:1784045266.860065:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808733568:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045266.860151:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808733568:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.860158:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:1.0:1784045266.860176:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:1.0:1784045266.860194:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808733696:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045266.860222:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808733696:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.860229:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00080000:1.0:1784045266.860249:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045266.860575:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733440 00000100:00100000:2.0:1784045266.860580:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733440 00000100:00100000:2.0:1784045266.860622:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 247 00000100:00100000:2.0:1784045266.860629:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808733440:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045266.860673:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930801850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808733440:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 44us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.860679:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 247 00010000:00010000:0.0:1784045267.169948:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045267.244311:0:11229:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784045268.193351:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045268.388434:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045268.388466:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829740672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045268.388543:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045268.388868:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740672 00000100:00100000:3.0:1784045268.388877:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740672 00000100:00100000:3.0:1784045268.389152:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045268.389164:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829740672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045268.389206:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045268.389264:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829740672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045268.389271:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1784045268.389335:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d6300 x1870706829740672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045268.389353:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829740672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784045268.389416:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045269.218851:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045270.241268:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045270.433673:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829741184:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.433751:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.433878:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045270.433886:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829741056:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.433914:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.433948:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741184 00000100:00100000:1.0:1784045270.433958:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741184 00000100:00100000:1.0:1784045270.434023:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045270.434032:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829741184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.434080:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829741184:12345-0@lo:400:kworker.0 Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.434087:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045270.434109:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741056 00000100:00100000:1.0:1784045270.434112:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741056 00000100:00100000:1.0:1784045270.434135:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784045270.434141:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829741056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.434168:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829741056:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.434187:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1784045270.434204:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045270.434209:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045270.434243:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829741056:0@lo:400:kworker.0 00010000:00080000:1.0:1784045270.434258:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdca80 x1870706829741184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045270.434269:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829741184:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.434631:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829740800:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.434676:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.434710:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829741312:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.434732:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.434749:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784045270.434754:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829740928:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.434772:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.434797:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829741440:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.434819:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.434866:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741440 00000100:00100000:2.0:1784045270.434869:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741440 00000100:00100000:2.0:1784045270.434915:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045270.434922:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829741440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.434960:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829741440:12345-0@lo:400:kworker.0 Request processed in 38us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.434966:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1784045270.434995:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdd500 x1870706829741440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045270.435019:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829741440:0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.435093:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740800 00000100:00100000:0.0:1784045270.435098:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740800 00000100:00100000:0.0:1784045270.435140:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1784045270.435148:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829740800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.435185:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa930800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829740800:12345-0@lo:400:kworker.0 Request processed in 39us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045270.435192:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1784045270.437118:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829740800:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.437318:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741312 00000100:00100000:1.0:1784045270.437324:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741312 00000100:00100000:0.0:1784045270.437367:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829741568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045270.437389:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829740928 00000100:00100000:1.0:1784045270.437393:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829740928 00000100:00100000:1.0:1784045270.437420:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045270.437427:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.437433:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829741312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.437472:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741568 00000100:00100000:0.0:1784045270.437476:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741568 00000100:00100000:1.0:1784045270.437514:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829741312:12345-0@lo:400:kworker.0 Request processed in 85us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045270.437517:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784045270.437528:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045270.437530:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829741568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045270.437550:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784045270.437560:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829740928:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784045270.437563:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045270.437605:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829740928:12345-0@lo:400:kworker.0 Request processed in 47us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045270.437613:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829741568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.437625:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045270.437637:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1784045270.437655:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045270.437661:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784045270.437675:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdca80 x1870706829741568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045270.437694:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829741568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045270.437864:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829740928:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.437876:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829741312:0@lo:400:kworker.0 00010000:00010000:3.0:1784045271.265530:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045271.329086:0:11328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:07:49 (1784045269) === 00000100:00100000:1.0:1784045271.556889:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.556974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045271.557068:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733952 00000100:00100000:0.0:1784045271.557078:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733952 00000100:00100000:0.0:1784045271.557146:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784045271.557171:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:9659:x1870706808733952:12345-192.168.201.58@tcp:700:mkdir.0 00000100:00100000:0.0:1784045271.557256:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:9659:x1870706808733952:12345-192.168.201.58@tcp:700:mkdir.0 Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045271.557264:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00080000:1.0:1784045271.557388:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045271.557478:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808733824 00000100:00100000:2.0:1784045271.557481:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808733824 00000100:00100000:2.0:1784045271.557503:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1784045271.557507:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808733824:12345-192.168.201.58@tcp:41:mkdir.0 00000004:00000024:2.0:1784045271.557533:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784045271.557579:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808733824:12345-192.168.201.58@tcp:41:mkdir.0 Request processed in 72us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.557583:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784045271.560963:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.561053:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808734208 00000100:00100000:3.0:1784045271.561064:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808734208 00000100:00100000:3.0:1784045271.561125:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:3.0:1784045271.561134:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:9659:x1870706808734208:12345-192.168.201.58@tcp:36:mkdir.0 00010000:00010000:3.0:1784045271.561198:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045271.561266:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2ccce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc7b expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.561298:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5800) 00010000:00010000:3.0:1784045271.561310:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045271.561734:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.561751:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.561760:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.561795:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.561802:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.561809:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045271.562977:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1784045271.562991:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.562999:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.563006:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.563012:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.563354:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.563363:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.563376:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:3.0:1784045271.563378:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045271.563383:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.563388:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cded lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045271.563407:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d0de677 reply state 00000000ddc594aa transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045271.563415:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045271.563577:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9659:x1870706808734208:12345-192.168.201.58@tcp:36:mkdir.0 Request processed in 2440us (2618us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784045271.563586:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:1.0:1784045271.567175:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.567193:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.567201:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.567207:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045271.567211:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.567219:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.567238:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa92210c900) 00010000:00010000:1.0:1784045271.567242:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045271.567247:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.567254:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cdf4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.579580:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045271.579696:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808734336 00000100:00100000:2.0:1784045271.579706:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808734336 00000100:00100000:2.0:1784045271.579780:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1784045271.579791:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:9660:x1870706808734336:12345-192.168.201.58@tcp:101:chmod.0 00010000:00010000:2.0:1784045271.579815:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045271.579882:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cdfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd00 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.579953:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2ce02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.579966:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2ce02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.579994:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2ce02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045271.580068:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784045271.580072:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045271.580110:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2ce02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.580137:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cdfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd00 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.580156:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2ce02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd00 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.580166:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa902ec0a00) 00010000:00010000:2.0:1784045271.580169:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045271.580172:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720200, rc 0) 00000100:00100000:2.0:1784045271.580228:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9660:x1870706808734336:12345-192.168.201.58@tcp:101:chmod.0 Request processed in 439us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.580235:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1784045271.586510:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.586618:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808734592 00000100:00100000:1.0:1784045271.586630:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808734592 00000100:00100000:1.0:1784045271.586695:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:1.0:1784045271.586706:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9660:x1870706808734592:12345-192.168.201.58@tcp:36:chmod.0 00010000:00010000:1.0:1784045271.586761:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045271.586808:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2ce02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd00 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.586871:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa902ec0a00) 00010000:00010000:1.0:1784045271.586885:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045271.586912:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.586925:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.586936:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045271.587272:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000094229b9b reply state 00000000476624bc transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.587283:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784045271.587297:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784045271.587389:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:9660:x1870706808734592:12345-192.168.201.58@tcp:36:chmod.0 Request processed in 684us (887us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784045271.587397:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00010000:00010000:3.0:1784045271.594153:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.594172:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.594180:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.594186:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.594191:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.594213:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.594231:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045271.594234:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784045271.594239:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.594245:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045271.630046:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.630167:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808734720 00000100:00100000:1.0:1784045271.630178:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808734720 00000100:00100000:1.0:1784045271.630244:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784045271.630253:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9661:x1870706808734720:12345-192.168.201.58@tcp:101:chown.0 00010000:00010000:1.0:1784045271.630279:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045271.630303:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd07 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.630396:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.630410:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.630424:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045271.630482:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784045271.630486:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045271.630521:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.630546:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd07 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.630569:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd07 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.630578:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045271.630581:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045271.630584:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360400, rc 0) 00000100:00100000:1.0:1784045271.630649:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:9661:x1870706808734720:12345-192.168.201.58@tcp:101:chown.0 Request processed in 397us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045271.630657:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784045271.649729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.650536:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808734848 00000100:00100000:3.0:1784045271.650548:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808734848 00000100:00100000:3.0:1784045271.650616:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784045271.650627:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:9661:x1870706808734848:12345-192.168.201.58@tcp:101:chown.0 00010000:00010000:3.0:1784045271.650647:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045271.650667:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd0e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.650733:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.650971:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.650985:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651003:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651029:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651038:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651133:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ce33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651142:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ce33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651149:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ce33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045271.651188:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784045271.651192:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045271.651219:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ce33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651231:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651238:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651244:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651250:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.651254:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651267:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651278:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045271.651281:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045271.651286:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651292:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651307:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651312:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651318:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651323:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.651326:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651332:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651338:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa92210cd00) 00010000:00010000:3.0:1784045271.651341:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045271.651343:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651357:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651389:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd0e expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651402:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ce33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd0e expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.651409:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa92210c600) 00010000:00010000:3.0:1784045271.651411:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045271.651413:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ea00, rc 0) 00000100:00100000:3.0:1784045271.651537:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:9661:x1870706808734848:12345-192.168.201.58@tcp:101:chown.0 Request processed in 911us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045271.651545:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784045271.657152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.657272:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808735104 00000100:00100000:1.0:1784045271.657294:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808735104 00000100:00100000:1.0:1784045271.657438:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1784045271.657448:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:9661:x1870706808735104:12345-192.168.201.58@tcp:36:chown.0 00010000:00010000:1.0:1784045271.657498:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045271.657524:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ce33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd0e expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.657542:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa92210c600) 00010000:00010000:1.0:1784045271.657551:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045271.657584:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.657597:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.657606:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045271.705074:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1784045271.705222:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f653d343 reply state 000000008f18e393 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.705237:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784045271.705410:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1784045271.705509:0:5806:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784045271.705678:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:9661:x1870706808735104:12345-192.168.201.58@tcp:36:chown.0 Request processed in 48227us (48850us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784045271.705688:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00010000:00010000:2.0:1784045271.707084:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.707098:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.707106:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.707127:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.707132:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.707140:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.707155:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045271.707159:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784045271.707163:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.707169:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2ce3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045271.729590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.730171:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808735232 00000100:00100000:1.0:1784045271.730182:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808735232 00000100:00100000:1.0:1784045271.730243:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1784045271.730268:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:9662:x1870706808735232:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:1.0:1784045271.730293:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045271.730325:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2ce41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd15 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045271.733891:0:5805:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3517us 00010000:00010000:2.0:1784045271.742996:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743019:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743032:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743050:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743057:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743063:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743479:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2ce56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743488:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2ce56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743496:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2ce56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045271.743582:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784045271.743586:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045271.743670:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2ce56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743681:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743688:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743695:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743701:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.743705:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743713:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743725:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:2.0:1784045271.743732:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045271.743737:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743743:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2ce48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743755:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743772:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743779:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743785:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.743788:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743793:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743800:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa902ec0e00) 00010000:00010000:2.0:1784045271.743803:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045271.743805:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743810:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2ce4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743866:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2ce41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd15 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743890:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2ce56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd15 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.743897:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045271.743900:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784045271.743902:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721c00, rc 0) 00000100:00100000:2.0:1784045271.743976:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9662:x1870706808735232:12345-192.168.201.58@tcp:101:touch.500 Request processed in 13711us (14396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.743985:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:2.0:1784045271.747047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045271.747122:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808735488 00000100:00100000:0.0:1784045271.747132:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808735488 00000100:00100000:0.0:1784045271.747224:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:0.0:1784045271.747236:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9662:x1870706808735488:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:0.0:1784045271.747257:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045271.747279:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33800/0xdb5b5ff6a2d2ce5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd1c expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.747608:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.747625:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.747637:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.747693:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.747701:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.747708:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045271.748511:0:7507:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784045271.748805:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2ce72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748816:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2ce72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748824:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2ce72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748882:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748890:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748897:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748902:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045271.748906:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748924:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748937:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:0.0:1784045271.748940:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045271.748945:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.748951:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33a00/0xdb5b5ff6a2d2ce64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045271.748964:0:7507:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066e509ed reply state 0000000058e7ad73 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045271.748974:0:7507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784045271.749005:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33800/0xdb5b5ff6a2d2ce5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd1c expref: 10 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.749018:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2ce72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd1c expref: 9 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.749025:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa9118c5200) 00010000:00010000:0.0:1784045271.749028:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045271.749030:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33200, rc 0) 00000100:00100000:0.0:1784045271.749098:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:9662:x1870706808735488:12345-192.168.201.58@tcp:101:touch.500 Request processed in 1866us (2061us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784045271.749107:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00010000:00010000:0.0:1784045271.752410:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.752438:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.752446:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.752452:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045271.752458:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.752466:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.752482:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5bdc1d92 (ffff8aa9118c5900) 00010000:00010000:0.0:1784045271.752486:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045271.752490:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.752496:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2ce6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045271.758146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.758439:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808735744 00000100:00100000:3.0:1784045271.758449:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808735744 00000100:00100000:3.0:1784045271.758499:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:3.0:1784045271.758510:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:9662:x1870706808735744:12345-192.168.201.58@tcp:36:touch.500 00010000:00010000:3.0:1784045271.758586:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045271.758613:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2ce72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd1c expref: 9 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.758650:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa9118c5200) 00010000:00010000:3.0:1784045271.758662:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045271.758704:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.758729:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.758739:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045271.758914:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000428ba3b3 reply state 000000007ec74347 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045271.758924:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045271.759014:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:9662:x1870706808735744:12345-192.168.201.58@tcp:36:touch.500 Request processed in 505us (876us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784045271.759021:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1784045271.763137:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.763213:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808735872 00000100:00100000:1.0:1784045271.763223:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808735872 00000100:00100000:1.0:1784045271.763281:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1784045271.763293:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:9662:x1870706808735872:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:1.0:1784045271.763341:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045271.763365:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2ce87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd23 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.763428:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2ce87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd23 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.763445:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2ce87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd23 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.763465:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa92210c100) 00010000:00010000:1.0:1784045271.763468:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045271.763472:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361400, rc 0) 00000100:00100000:1.0:1784045271.763534:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:9662:x1870706808735872:12345-192.168.201.58@tcp:101:touch.500 Request processed in 243us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045271.763541:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00010000:00010000:2.0:1784045271.763752:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.763772:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.763780:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.763786:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.763790:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.763799:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.763810:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa92210c100) 00010000:00010000:2.0:1784045271.763826:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045271.763858:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.763866:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2ce80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.766771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045271.767936:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808736000 00000100:00100000:2.0:1784045271.767948:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808736000 00000100:00100000:2.0:1784045271.768041:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1784045271.768051:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1870706808736000:12345-192.168.201.58@tcp:8:touch.500 00010000:00080000:2.0:1784045271.768083:0:8930:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1784045271.768117:0:8930:0:(genops.c:1406:class_connect()) connect: client 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1, cookie 0xdb5b5ff6a2d2ce8e 00002000:00100000:2.0:1784045271.768129:0:8930:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1/ffff8aa93a1eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784045271.768152:0:8930:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784045271.768385:0:8930:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784045271.768414:0:8930:0:(import.c:65:import_set_state_nolock()) ffff8aa93a1e9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045271.768483:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2359:x1870706808736000:12345-192.168.201.58@tcp:8:touch.500 Request processed in 431us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.768490:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1784045271.770390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045271.770662:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808736128 00000100:00100000:2.0:1784045271.770669:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808736128 00000100:00100000:2.0:1784045271.770741:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1784045271.770751:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:0:x1870706808736128:12345-192.168.201.58@tcp:2:touch.500 00000100:00080000:1.0:1784045271.771296:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1784045271.817980:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1784045271.818000:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000100:00100000:0.0:1784045271.820273:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:0:x1870706808736128:12345-192.168.201.58@tcp:2:touch.500 Request processed in 49509us (49878us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784045271.820289:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045271.824041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.824186:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808736384 00000100:00100000:3.0:1784045271.824197:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808736384 00000100:00100000:3.0:1784045271.824286:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784045271.824297:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:9662:x1870706808736384:12345-192.168.201.58@tcp:35:touch.500 00000100:00100000:3.0:1784045271.824794:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:9662:x1870706808736384:12345-192.168.201.58@tcp:35:touch.500 Request processed in 497us (762us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784045271.824819:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784045271.845520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.845629:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808736512 00000100:00100000:3.0:1784045271.845639:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808736512 00000100:00100000:3.0:1784045271.845711:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1784045271.845721:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:9663:x1870706808736512:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:3.0:1784045271.845744:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045271.845773:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd2a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.846007:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.846022:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.846034:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045271.846097:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784045271.846101:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045271.846141:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.846168:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2ce95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd2a expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.846185:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd2a expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.846212:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:3.0:1784045271.846215:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045271.846219:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f000, rc 0) 00000100:00100000:3.0:1784045271.846327:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:9663:x1870706808736512:12345-192.168.201.58@tcp:101:rm.0 Request processed in 607us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045271.846334:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1784045271.865296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.865456:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808736768 00000100:00100000:1.0:1784045271.865467:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808736768 00000100:00100000:1.0:1784045271.865574:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:1.0:1784045271.865586:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:9663:x1870706808736768:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:1.0:1784045271.865607:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045271.865627:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd31 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045271.865745:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784045271.866197:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cea3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd31 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.866213:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045271.866216:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045271.866222:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd31 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.866237:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361200, rc 0) 00000100:00100000:1.0:1784045271.866300:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:9663:x1870706808736768:12345-192.168.201.58@tcp:101:rm.0 Request processed in 716us (1012us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1784045271.866386:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1784045271.870581:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045271.870850:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808736896 00000100:00100000:0.0:1784045271.870861:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808736896 00000100:00100000:0.0:1784045271.870937:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1784045271.870949:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:9663:x1870706808736896:12345-192.168.201.58@tcp:37:rm.0 00000100:00100000:0.0:1784045271.877270:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:9663:x1870706808736896:12345-192.168.201.58@tcp:37:rm.0 Request processed in 6312us (6686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045271.877284:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1784045271.881499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.881728:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808737152 00000100:00100000:3.0:1784045271.881738:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808737152 00000100:00100000:3.0:1784045271.881808:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1784045271.881818:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:9663:x1870706808737152:12345-192.168.201.58@tcp:35:rm.0 00000100:00100000:3.0:1784045271.882111:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:9663:x1870706808737152:12345-192.168.201.58@tcp:35:rm.0 Request processed in 293us (620us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784045271.882120:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1784045271.885060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045271.885188:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808737408 00000100:00100000:0.0:1784045271.885197:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808737408 00000100:00100000:0.0:1784045271.885263:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:0.0:1784045271.885274:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:9663:x1870706808737408:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:0.0:1784045271.885298:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045271.885328:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2ceb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd38 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.885443:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2ceb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.885458:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2ceb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.885470:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2ceb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045271.885480:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784045271.885615:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2ceb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd38 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.885634:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2ceb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd38 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.885657:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:0.0:1784045271.885660:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784045271.885663:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33e00, rc 0) 00000100:00100000:0.0:1784045271.885901:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808737408:12345-192.168.201.58@tcp:101:rm.0 Request processed in 628us (848us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784045271.885909:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1784045271.890160:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045271.890372:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808737536 00000100:00100000:0.0:1784045271.890382:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808737536 00000100:00100000:0.0:1784045271.890477:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784045271.890489:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808737536:12345-192.168.201.58@tcp:41:rm.0 00000004:00000024:0.0:1784045271.890547:0:7507:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1784045271.890668:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808737536:12345-192.168.201.58@tcp:41:rm.0 Request processed in 181us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045271.890675:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784045271.893268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.893400:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808737664 00000100:00100000:3.0:1784045271.893409:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808737664 00000100:00100000:3.0:1784045271.893467:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:3.0:1784045271.893476:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808737664:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:3.0:1784045271.893495:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045271.893515:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd3f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893591:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893622:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893633:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893648:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893655:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893661:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893817:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893825:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893861:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045271.893888:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784045271.893891:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045271.893906:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893917:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893935:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893942:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893948:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893954:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.893958:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893965:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893976:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:3.0:1784045271.893979:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045271.893983:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.893989:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2cecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894002:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894008:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894014:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894024:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ea00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.894027:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894033:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894041:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5bdc1d92 (ffff8aa92210cd00) 00010000:00010000:3.0:1784045271.894043:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045271.894047:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894051:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2ced4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894080:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd3f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894095:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd3f expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.894103:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa92210c100) 00010000:00010000:3.0:1784045271.894105:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045271.894107:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045271.894159:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:9663:x1870706808737664:12345-192.168.201.58@tcp:101:rm.0 Request processed in 684us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045271.894167:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:3.0:1784045271.899640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.901053:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808737920 00000100:00100000:1.0:1784045271.901067:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808737920 00000100:00100000:1.0:1784045271.901141:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:1.0:1784045271.901152:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:9663:x1870706808737920:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:1.0:1784045271.901206:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784045271.901241:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cedb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd3f expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901264:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2ce87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd23 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901276:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa92210c100) 00010000:00010000:1.0:1784045271.901292:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2ce9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd2a expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901302:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:1.0:1784045271.901306:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045271.901325:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901338:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901347:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901362:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901369:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901375:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901488:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901501:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.901508:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045271.902348:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1784045271.902359:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306588528366ns, next at 307588526456ns, rc = 0 00010000:00010000:1.0:1784045271.902419:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903349:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903362:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903372:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903379:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903385:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903458:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045271.903483:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903488:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903507:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903512:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045271.903517:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903535:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903547:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa91040d500) 00010000:00010000:1.0:1784045271.903558:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784045271.903563:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903570:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2cef0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903591:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903598:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903604:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903610:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045271.903612:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903630:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903638:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:1.0:1784045271.903641:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045271.903644:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045271.903648:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2cee2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045271.903659:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8b1b746 reply state 0000000063d702e9 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.903668:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784045271.903782:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808737920:12345-192.168.201.58@tcp:36:rm.0 Request processed in 2628us (4148us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784045271.903790:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:1.0:1784045271.908286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.908636:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808738176 00000100:00100000:3.0:1784045271.908646:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808738176 00000100:00100000:3.0:1784045271.908701:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1784045271.908711:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808738176:12345-192.168.201.58@tcp:35:rm.0 00000100:00100000:3.0:1784045271.909006:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:9663:x1870706808738176:12345-192.168.201.58@tcp:35:rm.0 Request processed in 295us (727us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784045271.909013:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00010000:00010000:0.0:1784045271.909516:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045271.909527:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.909539:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045271.909543:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.909563:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.909580:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8aa91040d500) 00010000:00010000:0.0:1784045271.909596:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784045271.909602:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.909608:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045271.909627:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045271.909629:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045271.909631:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045271.909790:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.909799:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.909805:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.909811:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045271.909815:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.909821:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.909866:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x5bdc1d92 (ffff8aa91040d600) 00010000:00010000:3.0:1784045271.909869:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045271.909872:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.909878:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cee9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x5bdc1d92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.913274:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045271.913470:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808738432 00000100:00100000:3.0:1784045271.913481:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808738432 00000100:00100000:3.0:1784045271.913561:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1784045271.913572:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:9663:x1870706808738432:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:3.0:1784045271.913633:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784045271.913659:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2ceb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd38 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913681:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2ce56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd15 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913692:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:3.0:1784045271.913707:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360400/0xdb5b5ff6a2d2ce17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd07 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913715:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045271.913723:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045271.913746:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913769:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913779:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913791:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913807:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.913814:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.914143:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.914153:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045271.914161:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045271.915857:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784045271.915881:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915896:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915903:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915908:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.915913:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915921:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915936:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:2.0:1784045271.915939:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784045271.915944:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915950:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915973:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915978:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915984:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.915988:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.915997:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.916004:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.916011:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:2.0:1784045271.916014:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045271.916016:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.916022:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173400/0xdb5b5ff6a2d2cefe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045271.916034:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000099e8e7b reply state 0000000065e6c448 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045271.916043:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045271.916138:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:9663:x1870706808738432:12345-192.168.201.58@tcp:36:rm.0 Request processed in 2564us (2870us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784045271.916147:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00010000:00010000:2.0:1784045271.918692:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.918711:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.918719:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.918726:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045271.918732:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.918754:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.918781:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8aa92210ce00) 00010000:00010000:2.0:1784045271.918784:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045271.918788:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045271.918794:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2cf05 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045271.974350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045271.974437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045271.974543:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808738560 00000100:00100000:2.0:1784045271.974559:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808738560 00000100:00100000:2.0:1784045271.974623:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 249 00000100:00100000:2.0:1784045271.974633:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808738560:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045271.974710:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808738560:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.974717:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 249 00000100:00100000:0.0:1784045271.977275:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808738688 00000100:00100000:0.0:1784045271.977289:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808738688 00000100:00100000:0.0:1784045271.977426:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:0.0:1784045271.977438:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808738688:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045271.977531:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808738688:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 88us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045271.977539:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00080000:1.0:1784045271.988288:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784045272.290315:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045273.313087:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784045273.505439:0:6932:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308191606004ns, next at 309191603429ns, rc = 0 00000100:00100000:1.0:1784045273.505492:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045273.505514:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829741696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045273.505596:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045273.505877:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741696 00000100:00100000:3.0:1784045273.505885:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741696 00000100:00100000:3.0:1784045273.505949:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045273.505959:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829741696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045273.505993:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045273.506046:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829741696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045273.506053:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1784045273.506099:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d6300 x1870706829741696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045273.506118:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829741696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784045273.506509:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784045274.337163:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045275.360964:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045275.553339:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829742208:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.553416:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.553488:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045275.553495:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829742080:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.553519:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.553555:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829742208 00000100:00100000:3.0:1784045275.553563:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829742208 00000100:00100000:3.0:1784045275.553641:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045275.553650:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829742208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.553711:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829742208:12345-0@lo:400:kworker.0 Request processed in 62us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.553719:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045275.553741:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829742080 00000100:00100000:3.0:1784045275.553745:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829742080 00000100:00100000:3.0:1784045275.553774:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784045275.553781:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829742080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.553815:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829742080:12345-0@lo:400:kworker.0 Request processed in 34us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.553822:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784045275.553908:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829742080:0@lo:400:kworker.0 00010000:00080000:3.0:1784045275.553921:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93f7d5c00 x1870706829742208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045275.553932:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829742208:0@lo:400:kworker.0 00000100:00080000:1.0:1784045275.554030:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045275.554036:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045275.554168:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829741824:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554204:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.554237:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829742336:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554259:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.554286:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784045275.554292:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829741952:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554313:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.554331:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829742464:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554360:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.554385:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829742336 00000100:00100000:2.0:1784045275.554389:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829742336 00000100:00100000:2.0:1784045275.554421:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741952 00000100:00100000:2.0:1784045275.554423:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741952 00000100:00100000:2.0:1784045275.554436:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784045275.554442:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829742336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554477:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829742336:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.554484:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784045275.554495:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784045275.554500:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829741952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554525:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829741952:12345-0@lo:400:kworker.0 Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.554531:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784045275.554555:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829741952:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.554564:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829742336:0@lo:400:kworker.0 00000100:00080000:1.0:1784045275.554627:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045275.554681:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829741824 00000100:00100000:3.0:1784045275.554691:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829741824 00000100:00100000:3.0:1784045275.554733:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784045275.554740:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829741824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.554849:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829741824:12345-0@lo:400:kworker.0 Request processed in 87us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.554856:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1784045275.554885:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829742464 00000100:00100000:3.0:1784045275.554889:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829742464 00000100:00100000:3.0:1784045275.554919:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045275.554924:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829742464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.554957:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829742464:12345-0@lo:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.554963:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1784045275.554982:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045275.556014:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045275.556747:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829741824:0@lo:400:kworker.0 00010000:00080000:1.0:1784045275.556779:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa90abdd180 x1870706829742464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045275.556790:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829742464:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.557359:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829742592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045275.557425:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.562706:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829742592 00000100:00100000:3.0:1784045275.562723:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829742592 00000100:00100000:3.0:1784045275.562891:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045275.562910:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829742592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045275.562965:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045275.563261:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829742592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 359us (5834us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.563269:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1784045275.563348:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa93a0ac380 x1870706829742592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045275.563364:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829742592:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784045276.156314:0:11477:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1784045276.387535:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045277.089451:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045277.089503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045277.089532:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045277.089556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045277.089583:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808738944 00000100:00100000:3.0:1784045277.089617:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808738944 00000100:00100000:3.0:1784045277.089684:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739200 00000100:00100000:3.0:1784045277.089688:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739200 00000100:00100000:3.0:1784045277.089728:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:3.0:1784045277.089738:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2362:x1870706808738944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045277.089815:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2362:x1870706808738944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 79us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045277.089823:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:3.0:1784045277.089865:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1784045277.089872:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808739200:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045277.089901:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808739200:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045277.089907:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1784045277.089939:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808738816 00000100:00100000:3.0:1784045277.089942:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808738816 00000100:00100000:3.0:1784045277.090142:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 251 00000100:00100000:3.0:1784045277.090154:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808738816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045277.090181:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808738816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 30us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045277.090188:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 251 00000100:00100000:3.0:1784045277.090216:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739072 00000100:00100000:3.0:1784045277.090219:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739072 00000100:00100000:3.0:1784045277.090258:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1784045277.090265:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808739072:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045277.090293:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808739072:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045277.090307:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00080000:3.0:1784045277.090325:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045277.090329:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1784045277.162053:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1784045277.162077:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1784045277.162095:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1784045277.162125:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1784045277.162132:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1784045277.162381:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829742720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784045277.162453:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045277.162642:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829742720 00000100:00100000:3.0:1784045277.162651:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829742720 00000100:00100000:3.0:1784045277.162723:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045277.162732:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829742720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1784045277.162759:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1784045277.162798:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a565ed7, atime: 0x6a565ed7, ctime: 0x6a565ed7, blocks: 0x1 00010000:00010000:3.0:1784045277.162806:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045277.162823:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1784045277.162853:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045277.162860:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045277.162876:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045277.162886:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045277.162894:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045277.162910:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784045277.163517:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829742720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 783us (1060us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784045277.163526:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1784045277.163742:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1784045277.163780:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa93f7d6300/2, rc 0, transno 4294967300 00000100:00100000:1.0:1784045277.163787:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829742720:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784045277.163891:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045277.163899:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.163908:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045277.163913:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.163933:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.163963:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.163970:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fccd18d8/0xdb5b5ff6a2d2cf13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.163991:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045277.163993:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045277.163995:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784045277.403412:0:11527:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeae5b23a0 20000000:00000080:2.0:1784045277.403430:0:11527:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa939f5c400 uarg=0000000000000000 20000000:01000000:2.0:1784045277.403815:0:11527:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784045277.403822:0:11527:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784045277.404342:0:11527:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1784045277.407074:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1784045277.410679:0:11527:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00010000:00010000:1.0:1784045277.412647:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784045277.418525:0:11527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1784045277.418623:0:11527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1784045277.418700:0:11527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1784045277.418720:0:11527:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784045277.418740:0:11527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418759:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418767:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418774:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418783:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418789:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418811:0:11527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418938:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.418955:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 12 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.419045:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829742848:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045277.419454:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.419475:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.419484:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829742976:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045277.419519:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.419527:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 18 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.419537:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829743104:0@lo:104: 00000100:00100000:2.0:1784045277.419590:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045277.419632:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.419652:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 18 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.419661:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829743232:0@lo:104: 00000100:00100000:2.0:1784045277.419696:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045277.419726:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045277.419734:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 18 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.419743:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829743360:0@lo:104: 00000100:00100000:2.0:1784045277.419767:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045277.419778:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa907e9ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045277.419934:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784045277.419947:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743104 00000100:00100000:0.0:1784045277.419953:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743104 00000100:00100000:0.0:1784045277.420009:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743232 00000100:00100000:0.0:1784045277.420013:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743232 00000100:00100000:0.0:1784045277.420026:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743360 00000100:00100000:0.0:1784045277.420029:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743360 00000100:00100000:0.0:1784045277.420043:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045277.420053:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:11527:x1870706829743104:12345-0@lo:104: 00010000:00010000:0.0:1784045277.420064:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420125:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045277.420131:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+5:11527:x1870706829743104:12345-0@lo:104: Request processed in 81us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045277.420138:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045277.420156:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045277.420177:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:11527:x1870706829743232:12345-0@lo:104: 00010000:00010000:0.0:1784045277.420191:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420239:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784045277.420244:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+4:11527:x1870706829743232:12345-0@lo:104: Request processed in 83us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045277.420249:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045277.420262:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045277.420270:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11527:x1870706829743360:12345-0@lo:104: 00010000:00010000:0.0:1784045277.420276:0:5787:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420301:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784045277.420306:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+3:11527:x1870706829743360:12345-0@lo:104: Request processed in 39us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045277.420311:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1784045277.420352:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784045277.420358:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420365:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045277.420369:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420376:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045277.420383:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045277.420396:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045277.420425:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420431:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045277.420449:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420468:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148f400/0xdb5b5ff6a2d2cdd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdd8 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420482:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045277.420485:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420490:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045277.420493:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420499:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045277.420506:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045277.420511:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045277.420524:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420529:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045277.420543:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420549:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa939e32000/0xdb5b5ff6a2d2cdc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420559:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045277.420562:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420568:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045277.420571:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420578:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045277.420584:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045277.420588:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045277.420600:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420605:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045277.420618:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420624:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa92d360c00/0xdb5b5ff6a2d2cdb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2cdbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.420637:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045277.420643:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045277.420645:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045277.420675:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829743616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045277.420708:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045277.420738:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045277.420744:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829743488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045277.420766:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045277.420793:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829743744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045277.420816:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045277.420871:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743616 00000100:00100000:0.0:1784045277.420876:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743616 00010000:00010000:0.0:1784045277.420899:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 19 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045277.420921:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743488 00000100:00100000:0.0:1784045277.420924:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743488 00010000:00010000:0.0:1784045277.420936:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 20 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045277.420952:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743744 00000100:00100000:0.0:1784045277.420954:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743744 00010000:00010000:0.0:1784045277.420966:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 21 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045277.420978:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045277.420984:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3321:x1870706829743616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045277.420993:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045277.420998:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 21 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.421017:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 21 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.421034:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045277.421062:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+21:3321:x1870706829743616:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045277.421068:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045277.421081:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045277.421089:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3321:x1870706829743488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045277.421096:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045277.421101:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 20 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.421108:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 20 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.421118:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045277.421139:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+20:3321:x1870706829743488:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045277.421145:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045277.421157:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045277.421165:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829743744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045277.421172:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045277.421176:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 19 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.421184:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 19 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045277.421201:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045277.421227:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907eeb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829743744:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045277.421234:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045277.421295:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829743744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045277.421315:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829743488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045277.421322:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829743616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045277.421731:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e33600/0xdb5b5ff6a2d2cdd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdd1 expref: 18 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.421743:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829743104:0@lo:104: 00010000:00010000:2.0:1784045277.421754:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e32600/0xdb5b5ff6a2d2cdca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdc3 expref: 17 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.421762:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829743232:0@lo:104: 00010000:00010000:2.0:1784045277.421771:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa90148e000/0xdb5b5ff6a2d2cdbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2cdb5 expref: 16 pid: 5799 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045277.421779:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829743360:0@lo:104: 00010000:00010000:2.0:1784045277.421918:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045277.429886:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829742848:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045277.429905:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1870706829742976:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045277.429947:0:11527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045277.431903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045277.432005:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045277.432154:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739328 00000100:00100000:1.0:1784045277.432163:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739328 00010000:00010000:1.0:1784045277.432201:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 13 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045277.432239:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739456 00000100:00100000:1.0:1784045277.432243:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739456 00010000:00010000:1.0:1784045277.432253:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 14 pid: 5796 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045277.432272:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784045277.432297:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+14:2360:x1870706808739328:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045277.432313:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045277.432319:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432330:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432346:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cde6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf9 expref: 14 pid: 5797 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432359:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045277.432398:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808739328:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 105us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045277.432403:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784045277.432418:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:1.0:1784045277.432422:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:2360:x1870706808739456:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045277.432428:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045277.432430:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432436:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432442:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e32a00/0xdb5b5ff6a2d2cddf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcf2 expref: 12 pid: 5796 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432450:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432460:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432472:0:7497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432476:0:7497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432481:0:7497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432485:0:7497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432489:0:7497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045277.432491:0:7497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432496:0:7497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432504:0:7497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.432510:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045277.432524:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:2360:x1870706808739456:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 102us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045277.432528:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00010000:00010000:1.0:1784045277.433119:0:11527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.433132:0:11527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045277.433136:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937721600/0xdb5b5ff6a2d2cf1a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045278.433037:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045278.624490:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045278.624707:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739584 00000100:00100000:2.0:1784045278.624718:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739584 00000100:00100000:2.0:1784045278.624779:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 252 00000100:00100000:2.0:1784045278.624789:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:5579:x1870706808739584:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045278.624806:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045278.624826:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2cf21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd46 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045278.624894:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2cf21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd46 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045278.624906:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2cf21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd46 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045278.624915:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720400, rc 0) 00000100:00100000:2.0:1784045278.624997:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808739584:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 209us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045278.625004:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 252 00000100:00100000:0.0:1784045278.625609:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829743872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045278.625696:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045278.626711:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829743872 00000100:00100000:3.0:1784045278.626722:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829743872 00000100:00100000:3.0:1784045278.626778:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045278.626797:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829743872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045278.626850:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045278.626913:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829743872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045278.626920:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784045278.627530:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829743872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045278.632706:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045278.632866:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739712 00000100:00100000:3.0:1784045278.632876:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739712 00000100:00100000:3.0:1784045278.632936:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 253 00000100:00100000:3.0:1784045278.632946:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808739712:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045278.633217:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808739712:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 272us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045278.633225:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 253 00000100:00100000:1.0:1784045278.635325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045278.635395:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739840 00000100:00100000:3.0:1784045278.635404:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739840 00000100:00100000:3.0:1784045278.635513:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 254 00000100:00100000:3.0:1784045278.635523:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808739840:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045278.636164:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808739840:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 640us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045278.636173:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 254 00000100:00100000:1.0:1784045278.649565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045278.649962:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808739968 00000100:00100000:2.0:1784045278.649971:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808739968 00000100:00100000:2.0:1784045278.650025:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 255 00000100:00100000:2.0:1784045278.650034:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:9933:x1870706808739968:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045278.650271:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90698b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:9933:x1870706808739968:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 237us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045278.650279:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 255 00000100:00100000:1.0:1784045278.654414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045278.655211:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740096 00000100:00100000:3.0:1784045278.655222:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740096 00000100:00100000:2.0:1784045278.655588:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 256 00000100:00100000:2.0:1784045278.655599:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:9933:x1870706808740096:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045278.655912:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:9933:x1870706808740096:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 313us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045278.655921:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 256 00000100:00100000:3.0:1784045278.661222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045278.680046:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740224 00000100:00100000:1.0:1784045278.680062:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740224 00000100:00100000:1.0:1784045278.680114:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 257 00000100:00100000:1.0:1784045278.680123:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:5579:x1870706808740224:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045278.680140:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045278.680157:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2cf28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd4d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045278.680607:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2cf28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd4d expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045278.680623:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2cf28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd4d expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045278.680633:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360400, rc 0) 00000100:00100000:1.0:1784045278.680715:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808740224:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 591us (19501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045278.680735:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 257 00000100:00100000:3.0:1784045278.711428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045278.711690:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740352 00000100:00100000:1.0:1784045278.711702:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740352 00000100:00100000:1.0:1784045278.711767:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 258 00000100:00100000:1.0:1784045278.711778:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808740352:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045278.712115:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808740352:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 338us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045278.712124:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 258 00000100:00100000:3.0:1784045278.722344:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045278.722584:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740480 00000100:00100000:0.0:1784045278.722595:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740480 00000100:00100000:0.0:1784045278.722667:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 259 00000100:00100000:0.0:1784045278.722679:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808740480:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045278.722955:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:5579:x1870706808740480:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 278us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045278.722964:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 259 00000100:00100000:3.0:1784045278.734054:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045278.734171:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740608 00000100:00100000:2.0:1784045278.734181:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740608 00000100:00100000:2.0:1784045278.734251:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 260 00000100:00100000:2.0:1784045278.734271:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:9936:x1870706808740608:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045278.734543:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:9936:x1870706808740608:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 272us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045278.734550:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 260 00000100:00100000:3.0:1784045278.745274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045278.745420:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740736 00000100:00100000:1.0:1784045278.745430:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740736 00000100:00100000:1.0:1784045278.745492:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 261 00000100:00100000:1.0:1784045278.745503:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:9936:x1870706808740736:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045278.745771:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:9936:x1870706808740736:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 269us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045278.745779:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 261 10000000:01000000:0.0:1784045279.266546:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045279.266556:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa93f779800 from 7 10000000:01000000:0.0:1784045279.266562:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045279.266612:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.266624:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.266663:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045279.266690:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.266760:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.266819:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971000 going to sleep for 11 seconds 00000100:00100000:2.0:1784045279.266993:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744000 00000100:00100000:2.0:1784045279.267000:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744000 00000100:00100000:2.0:1784045279.267071:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784045279.267080:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:5801:x1870706829744000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045279.267092:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045279.267106:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721200/0xdb5b5ff6a2d2cf36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cf2f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045279.267131:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721200/0xdb5b5ff6a2d2cf36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf2f expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045279.267141:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721200/0xdb5b5ff6a2d2cf36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf2f expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045279.267149:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721200, rc 0) 00000100:00100000:2.0:1784045279.267198:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829744000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045279.267214:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784045279.267315:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045279.267329:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.267337:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045279.267393:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.267417:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.267454:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971000 going to sleep for 11 seconds 00000100:00100000:2.0:1784045279.267826:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744128 00000100:00100000:2.0:1784045279.267852:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744128 00000100:00100000:2.0:1784045279.267888:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784045279.267904:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829744128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045279.268512:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829744128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 607us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045279.268521:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784045279.268677:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.268716:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.268751:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.268781:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045279.269233:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744256 00000100:00100000:1.0:1784045279.269240:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744256 00000100:00100000:1.0:1784045279.269295:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1784045279.269304:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829744256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045279.269455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829744256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045279.269462:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784045279.269619:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.278037:0:11541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11541:1870706829744384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045279.278137:0:11541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.278185:0:11541:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045279.278316:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744384 00000100:00100000:1.0:1784045279.278323:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744384 00000100:00100000:1.0:1784045279.278373:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784045279.278388:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:11541:x1870706829744384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045279.278622:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:11541:x1870706829744384:12345-0@lo:502:llog_process_th.0 Request processed in 234us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045279.278629:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784045279.278876:0:11541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11541:1870706829744384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045279.278920:0:11541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045279.278929:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045279.278931:0:11541:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784045279.278938:0:11541:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa93f779800 00000020:00000080:3.0:1784045279.278941:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045279.279027:0:11541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11541:1870706829744512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045279.279076:0:11541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.279102:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744512 00000100:00100000:3.0:1784045279.279106:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744512 00000100:00100000:3.0:1784045279.279130:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784045279.279137:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:11541:x1870706829744512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045279.279254:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:11541:x1870706829744512:12345-0@lo:502:llog_process_th.0 Request processed in 117us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045279.279260:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784045279.279294:0:11541:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045279.279312:0:11541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11541:1870706829744512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045279.279328:0:11541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045279.279332:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045279.279333:0:11541:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784045279.279336:0:11541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784045279.279653:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784045279.279674:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045279.279683:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.279695:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045279.279706:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045279.279708:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa907eaf000 from 7 10000000:01000000:3.0:1784045279.279711:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045279.279734:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.279742:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.279750:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045279.279765:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.279793:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.279808:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045279.279821:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744640 00000100:00100000:3.0:1784045279.279825:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744640 00000100:00100000:3.0:1784045279.279886:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784045279.279904:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:5801:x1870706829744640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045279.279913:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045279.279924:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cf44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cf3d expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.279944:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cf44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf3d expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.279954:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cf44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf3d expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.279962:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173000, rc 0) 00000100:00100000:3.0:1784045279.279994:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829744640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045279.280000:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784045279.280028:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045279.280177:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.280186:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045279.280230:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.280256:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.280276:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045279.280287:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744768 00000100:00100000:3.0:1784045279.280291:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744768 00000100:00100000:3.0:1784045279.280314:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045279.280320:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829744768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.280544:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829744768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045279.280548:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045279.280568:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.280585:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.280610:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.280619:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045279.280627:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829744896 00000100:00100000:3.0:1784045279.280629:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829744896 00000100:00100000:3.0:1784045279.280654:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784045279.280660:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829744896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.282121:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829744896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1455us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045279.282131:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784045279.283033:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829744896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045279.288122:0:11543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11543:1870706829745024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045279.288203:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045279.288242:0:11543:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9101950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045279.288326:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745024 00000100:00100000:1.0:1784045279.288332:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745024 00000100:00100000:1.0:1784045279.288375:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1784045279.288383:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:11543:x1870706829745024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045279.288587:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:11543:x1870706829745024:12345-0@lo:502:llog_process_th.0 Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045279.288594:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784045279.288737:0:11543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11543:1870706829745024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045279.288761:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045279.288770:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045279.288773:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784045279.288779:0:11543:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa907eaf000 00000020:00000080:2.0:1784045279.288782:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784045279.288882:0:11543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11543:1870706829745152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045279.288925:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045279.294936:0:11543:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9101950c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045279.303629:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745152 00000100:00100000:3.0:1784045279.303657:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745152 00000100:00100000:3.0:1784045279.303768:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784045279.303780:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:11543:x1870706829745152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045279.304556:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:11543:x1870706829745152:12345-0@lo:502:llog_process_th.0 Request processed in 774us (15625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045279.304566:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784045279.304685:0:11543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11543:1870706829745152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045279.304720:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045279.304735:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045279.304737:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784045279.304742:0:11543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784045279.306182:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784045279.306211:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045279.306222:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.306235:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045279.306246:0:5801:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045279.306248:0:5801:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90538d800 from 7 10000000:01000000:3.0:1784045279.306251:0:5801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045279.306283:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.306291:0:5801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.306300:0:5801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045279.306323:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829745280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.306382:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.306691:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745280 00000100:00100000:0.0:1784045279.306699:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745280 00000100:00100000:0.0:1784045279.306751:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784045279.306761:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:5801:x1870706829745280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045279.306775:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045279.306788:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e33800/0xdb5b5ff6a2d2cf52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2cf4b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.306812:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e33800/0xdb5b5ff6a2d2cf52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf4b expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.306824:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e33800/0xdb5b5ff6a2d2cf52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf4b expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.306854:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33800, rc 0) 00000100:00100000:3.0:1784045279.307319:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930353cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045279.307343:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829745280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045279.307360:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045279.307387:0:5801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045279.307518:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829745408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045279.307548:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.307565:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930353cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045279.308296:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829745280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045279.308305:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1784045279.308339:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745408 00000100:00100000:0.0:1784045279.308344:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745408 00000100:00100000:0.0:1784045279.308373:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784045279.308381:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829745408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.308727:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829745408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045279.308735:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1784045279.308775:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829745408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.308827:0:5801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829745536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.308887:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.308910:0:5801:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045279.308921:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745536 00000100:00100000:0.0:1784045279.308924:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745536 00000100:00100000:0.0:1784045279.308941:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1784045279.308946:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829745536:12345-0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784045279.309845:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784045279.310323:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:5801:x1870706829745536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1373us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045279.310333:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784045279.310420:0:5801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:5801:1870706829745536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045279.310965:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11546:1870706829745664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045279.311009:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045279.311138:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045279.311247:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745664 00000100:00100000:2.0:1784045279.311254:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745664 00000100:00100000:2.0:1784045279.311331:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1784045279.311340:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:11546:x1870706829745664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045279.311567:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:11546:x1870706829745664:12345-0@lo:502:llog_process_th.0 Request processed in 227us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045279.311574:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784045279.311657:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11546:1870706829745664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045279.311683:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045279.311693:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045279.311696:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784045279.311702:0:11546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa90538d800 00000020:00000080:3.0:1784045279.311705:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045279.314311:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11546:1870706829745792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045279.314387:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.314583:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930353cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045279.317003:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745792 00000100:00100000:0.0:1784045279.317018:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745792 00000100:00100000:1.0:1784045279.318867:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784045279.318883:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:11546:x1870706829745792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045279.319371:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:11546:x1870706829745792:12345-0@lo:502:llog_process_th.0 Request processed in 491us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045279.319380:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784045279.319610:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:11546:1870706829745792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045279.319657:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045279.319665:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045279.319668:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784045279.319672:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784045279.321917:0:5801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784045279.321954:0:5801:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045279.321967:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045279.321981:0:5801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045279.457177:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045280.354128:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784045280.481170:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045280.673181:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829746176:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.673254:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045280.674127:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829745920:0@lo:400:kworker.0 00000100:00100000:2.0:1784045280.674189:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045280.674223:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045280.674229:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829746048:0@lo:400:kworker.0 00000100:00100000:2.0:1784045280.674255:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045280.674366:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829745920 00000100:00100000:2.0:1784045280.674374:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829745920 00000100:00100000:2.0:1784045280.674423:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784045280.674432:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829745920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045280.674481:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829745920:12345-0@lo:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045280.674488:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784045280.674519:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746176 00000100:00100000:2.0:1784045280.674523:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746176 00000100:00100000:2.0:1784045280.674554:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746048 00000100:00100000:2.0:1784045280.674557:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746048 00000100:00100000:2.0:1784045280.674573:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784045280.674579:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829746176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675254:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784045280.675278:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829746048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675327:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829746048:12345-0@lo:400:kworker.0 Request processed in 64us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045280.675360:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784045280.675415:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829746304:0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675448:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045280.675482:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045280.675489:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829746432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045280.675515:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045280.675558:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045280.675588:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829746048:0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675599:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829745920:0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675642:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746304 00000100:00100000:0.0:1784045280.675647:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746304 00000100:00100000:0.0:1784045280.675714:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784045280.675723:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829746304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675760:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829746304:12345-0@lo:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045280.675767:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1784045280.675786:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045280.675803:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829746304:0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.675827:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746432 00000100:00100000:0.0:1784045280.675848:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746432 00000100:00100000:0.0:1784045280.675877:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784045280.675885:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829746432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045280.675924:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045280.675958:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829746432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045280.675974:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1784045280.675992:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784045280.676010:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d34700 x1870706829746432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045280.676024:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829746432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045280.680036:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045280.680335:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829746560:0@lo:400:kworker.0 00000100:00100000:3.0:1784045280.680407:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045280.680600:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746560 00000100:00100000:0.0:1784045280.680619:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746560 00000100:00100000:0.0:1784045280.680707:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784045280.680717:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829746560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.680772:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829746560:12345-0@lo:400:kworker.0 Request processed in 57us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045280.680780:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1784045280.681306:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045280.681353:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829746560:0@lo:400:kworker.0 00000100:00100000:2.0:1784045280.687259:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829746176:12345-0@lo:400:kworker.0 Request processed in 12666us (13991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045280.687275:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784045280.687689:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829746176:0@lo:400:kworker.0 00010000:00010000:2.0:1784045281.505071:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045282.218812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045282.218877:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045282.218908:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045282.218953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045282.218978:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740992 00000100:00100000:1.0:1784045282.218986:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740992 00000100:00100000:1.0:1784045282.219056:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741248 00000100:00100000:1.0:1784045282.219059:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741248 00000100:00100000:1.0:1784045282.219078:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:1.0:1784045282.219086:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808740992:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045282.219148:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808740992:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045282.219156:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:1.0:1784045282.219172:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:1.0:1784045282.219177:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808741248:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045282.219197:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808741248:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 20us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045282.219203:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:2.0:1784045282.219285:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808740864 00000100:00100000:2.0:1784045282.219289:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808740864 00000100:00100000:2.0:1784045282.219322:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 278 00000100:00100000:2.0:1784045282.219328:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808740864:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045282.219366:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808740864:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 38us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045282.219372:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 278 00000100:00100000:3.0:1784045282.219909:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741120 00000100:00100000:3.0:1784045282.219916:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741120 00000100:00100000:3.0:1784045282.219945:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1784045282.219951:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808741120:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045282.219980:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808741120:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045282.219987:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00080000:3.0:1784045282.220145:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045282.220149:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1784045282.283123:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1784045282.531631:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045283.554036:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045283.745424:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045283.745450:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829746688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045283.745520:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045283.745643:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746688 00000100:00100000:2.0:1784045283.745651:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746688 00000100:00100000:2.0:1784045283.745718:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045283.745727:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829746688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045283.745759:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045283.745807:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829746688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045283.745815:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045283.745866:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1784045283.745872:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa93f7d6300, transno 4294967300 00000100:00100000:2.0:1784045283.745886:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829746688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784045283.746159:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045284.577094:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045285.608567:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045285.793193:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829746944:0@lo:400:kworker.0 00000100:00100000:0.0:1784045285.793265:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045285.793513:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829747072:0@lo:400:kworker.0 00000100:00100000:1.0:1784045285.793655:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746944 00000100:00100000:1.0:1784045285.793663:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746944 00000100:00100000:1.0:1784045285.793713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784045285.793722:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829746944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045285.793902:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829746816:0@lo:400:kworker.0 00000100:00100000:3.0:1784045285.794010:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045285.794058:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829747584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045285.794085:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045285.801088:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747584 00000100:00100000:3.0:1784045285.801104:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747584 00000100:00100000:3.0:1784045285.801274:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784045285.801415:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829747584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045285.801458:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045285.801556:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829747584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (7469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045285.801563:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1784045285.801611:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191e300 x1870706829747584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045285.801631:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829747584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045285.801755:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747072 00000100:00100000:3.0:1784045285.801759:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747072 00000100:00100000:3.0:1784045285.801793:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784045285.801799:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829747072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045285.801856:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829747072:12345-0@lo:400:kworker.0 Request processed in 57us (7846us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045285.801862:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784045285.801884:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829747200:0@lo:400:kworker.0 00000100:00100000:3.0:1784045285.801917:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045285.801971:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829747072:0@lo:400:kworker.0 00000100:00100000:3.0:1784045285.802002:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747200 00000100:00100000:3.0:1784045285.802005:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747200 00000100:00100000:3.0:1784045285.802031:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784045285.802037:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045285.802071:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829747200:12345-0@lo:400:kworker.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045285.802077:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1784045285.802092:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045285.802096:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045285.802098:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045285.802114:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829747200:0@lo:400:kworker.0 00000100:00100000:0.0:1784045285.802269:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829747456:0@lo:400:kworker.0 00000100:00100000:0.0:1784045285.802310:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045285.802336:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747456 00000100:00100000:0.0:1784045285.802340:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747456 00000100:00100000:0.0:1784045285.802383:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045285.802399:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829747456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045285.802432:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829747456:12345-0@lo:400:kworker.0 Request processed in 36us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045285.802438:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1784045285.802470:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191ce00 x1870706829747456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045285.802480:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829747456:0@lo:400:kworker.0 00000100:00100000:1.0:1784045285.802785:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829746944:12345-0@lo:400:kworker.0 Request processed in 9062us (9518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045285.802793:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045285.803246:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829746944:0@lo:400:kworker.0 00000100:00100000:2.0:1784045285.803459:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045285.803493:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829747328:0@lo:400:kworker.0 00000100:00100000:2.0:1784045285.803534:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045285.804568:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829746816 00000100:00100000:0.0:1784045285.804578:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829746816 00000100:00100000:0.0:1784045285.804639:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784045285.804666:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829746816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045285.804737:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829746816:12345-0@lo:400:kworker.0 Request processed in 75us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045285.804745:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784045285.804967:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829746816:0@lo:400:kworker.0 00000100:00100000:1.0:1784045285.808269:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747328 00000100:00100000:1.0:1784045285.808401:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747328 00000100:00100000:1.0:1784045285.808585:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784045285.808595:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045285.810654:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829747328:12345-0@lo:400:kworker.0 Request processed in 2052us (7121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045285.810668:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784045285.810790:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829747328:0@lo:400:kworker.0 00000100:00080000:3.0:1784045285.815474:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784045286.625008:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045287.331407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045287.331439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045287.331462:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741376 00000100:00100000:3.0:1784045287.331477:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741376 00000100:00100000:3.0:1784045287.331549:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 280 00000100:00100000:3.0:1784045287.331559:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808741376:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045287.331628:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808741376:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 70us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045287.331636:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 280 00000100:00100000:3.0:1784045287.331778:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741632 00000100:00100000:3.0:1784045287.331782:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741632 00000100:00100000:3.0:1784045287.331817:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:3.0:1784045287.331824:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808741632:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045287.331880:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808741632:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 56us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045287.331886:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00080000:3.0:1784045287.331925:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045287.337032:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045287.337076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045287.337110:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741504 00000100:00100000:3.0:1784045287.337120:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741504 00000100:00080000:3.0:1784045287.337146:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045287.337187:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741760 00000100:00100000:3.0:1784045287.337191:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741760 00000100:00080000:3.0:1784045287.337241:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045287.337270:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:3.0:1784045287.337281:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808741504:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045287.337353:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808741504:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045287.337361:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:3.0:1784045287.337391:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:3.0:1784045287.337397:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808741760:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045287.337421:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808741760:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045287.337426:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00010000:00010000:0.0:1784045287.654021:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045288.673015:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045288.865075:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045288.865099:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829747712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045288.865171:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045288.865400:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747712 00000100:00100000:1.0:1784045288.865409:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747712 00000100:00100000:1.0:1784045288.865489:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784045288.865499:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829747712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045288.865534:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045288.865580:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829747712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045288.865587:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1784045288.865714:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045288.865786:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829747712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045289.697265:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045290.593599:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784045290.721044:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045290.913166:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045290.913192:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829747840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045290.913274:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045290.913551:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747840 00000100:00100000:3.0:1784045290.913559:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747840 00000100:00100000:3.0:1784045290.913625:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784045290.913633:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829747840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045290.913669:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045290.913716:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829747840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045290.913724:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1784045290.913914:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784045290.913945:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d063100 x1870706829747840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045290.913963:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829747840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045290.915014:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829748096:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915060:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045290.915096:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784045290.915102:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829747968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915129:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045290.915156:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829748480:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915178:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045290.915207:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829747968 00000100:00100000:1.0:1784045290.915212:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829747968 00000100:00100000:1.0:1784045290.915264:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784045290.915271:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829747968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915330:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829747968:12345-0@lo:400:kworker.0 Request processed in 59us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045290.915338:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1784045290.915370:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748096 00000100:00100000:1.0:1784045290.915374:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748096 00000100:00100000:1.0:1784045290.915397:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748480 00000100:00100000:1.0:1784045290.915401:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748480 00000100:00100000:1.0:1784045290.915425:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784045290.915432:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829748096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915478:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829748096:12345-0@lo:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045290.915484:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784045290.915496:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784045290.915502:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829748480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915541:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829748480:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045290.915547:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1784045290.915569:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045290.915593:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829747968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915604:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829748480:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915611:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829748096:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915637:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829748224:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915661:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045290.915678:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045290.915683:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829748352:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.915713:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045290.916075:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748224 00000100:00100000:0.0:1784045290.916088:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748224 00000100:00100000:0.0:1784045290.916133:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045290.916141:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045290.916176:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829748224:12345-0@lo:400:kworker.0 Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045290.916182:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045290.916201:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748352 00000100:00100000:0.0:1784045290.916204:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748352 00000100:00100000:0.0:1784045290.916243:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045290.916251:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045290.916281:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829748352:12345-0@lo:400:kworker.0 Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045290.916286:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1784045290.916309:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045290.916312:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045290.916670:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829748352:0@lo:400:kworker.0 00000100:00100000:1.0:1784045290.916682:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829748224:0@lo:400:kworker.0 00010000:00010000:0.0:1784045291.745239:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045292.454567:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045292.455571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045292.455703:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808741888 00000100:00100000:3.0:1784045292.455716:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808741888 00000100:00100000:3.0:1784045292.455786:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 282 00000100:00100000:3.0:1784045292.455799:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808741888:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045292.456529:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742016 00000100:00100000:0.0:1784045292.456538:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742016 00000100:00100000:0.0:1784045292.457284:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:0.0:1784045292.457313:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808742016:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:2.0:1784045292.457481:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045292.457577:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808741888:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 1776us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045292.457589:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 282 00000100:00100000:0.0:1784045292.457718:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808742016:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 422us (2152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045292.457728:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1784045292.472248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045292.472315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045292.472511:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742144 00000100:00100000:0.0:1784045292.472522:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742144 00000100:00100000:0.0:1784045292.472597:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784045292.472641:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2359:x1870706808742144:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:0.0:1784045292.472678:0:6600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ce8e 00000100:00080000:0.0:1784045292.472688:0:6600:0:(import.c:65:import_set_state_nolock()) ffff8aa93a1e9800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1784045292.472797:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1784045292.472929:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1784045292.473184:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+2:2359:x1870706808742144:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 565us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045292.473193:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00010000:00010000:0.0:1784045292.473212:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045292.473667:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742272 00000100:00100000:1.0:1784045292.473672:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742272 00000100:00100000:1.0:1784045292.473730:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:1.0:1784045292.473737:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808742272:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045292.473783:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808742272:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 45us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045292.473789:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00080000:2.0:1784045292.473926:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784045292.771350:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045293.793009:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045293.985865:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829748608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045293.985950:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045293.987381:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748608 00000100:00100000:2.0:1784045293.987419:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748608 00000100:00100000:2.0:1784045293.987514:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784045293.987527:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829748608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045293.987566:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045293.987632:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829748608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045293.987640:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784045293.987759:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829748608:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784045293.988357:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045294.818631:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045295.841042:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045296.033435:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829748992:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.033535:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.033627:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045296.033635:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829749120:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.033678:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.033816:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748992 00000100:00100000:3.0:1784045296.033826:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748992 00000100:00100000:3.0:1784045296.033923:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784045296.033934:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829748992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.034000:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829748992:12345-0@lo:400:kworker.0 Request processed in 69us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.034027:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784045296.034229:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749120 00000100:00100000:0.0:1784045296.034235:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749120 00000100:00100000:0.0:1784045296.034281:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045296.034304:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829749120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.034344:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829749120:12345-0@lo:400:kworker.0 Request processed in 57us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045296.034361:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045296.034384:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829748864:0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.034415:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045296.034432:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829749376:0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.034453:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045296.034474:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784045296.034479:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829748736:0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.034522:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045296.034553:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829749248:0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.034574:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045296.034601:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748864 00000100:00100000:0.0:1784045296.034604:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748864 00000100:00100000:0.0:1784045296.034626:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749248 00000100:00100000:0.0:1784045296.034628:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749248 00000100:00100000:0.0:1784045296.034642:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784045296.034737:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749376 00000100:00100000:3.0:1784045296.034741:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749376 00000100:00100000:3.0:1784045296.034771:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784045296.034778:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.034818:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829749376:12345-0@lo:400:kworker.0 Request processed in 40us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.034824:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784045296.034887:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784045296.034894:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829749248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.034926:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829749248:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.034932:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784045296.035017:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829748864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.035058:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829748864:12345-0@lo:400:kworker.0 Request processed in 401us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045296.035065:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1784045296.035108:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829749248:0@lo:400:kworker.0 00000100:00100000:0.0:1784045296.035120:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829748864:0@lo:400:kworker.0 00010000:00080000:0.0:1784045296.035133:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191ce00 x1870706829749376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045296.035143:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829749376:0@lo:400:kworker.0 00000100:00080000:2.0:1784045296.035229:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045296.035235:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045296.035238:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045296.035260:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829749120:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.035273:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829748992:0@lo:400:kworker.0 00000100:00100000:1.0:1784045296.036198:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829748736 00000100:00100000:1.0:1784045296.036214:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829748736 00000100:00100000:3.0:1784045296.036252:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045296.036273:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829749504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045296.036287:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1784045296.036300:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829748736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.036333:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045296.036435:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829748736:12345-0@lo:400:kworker.0 Request processed in 137us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045296.036445:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1784045296.036467:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749504 00000100:00100000:2.0:1784045296.036491:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749504 00000100:00100000:2.0:1784045296.036546:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784045296.036554:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829749504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045296.036596:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045296.036741:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829749504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045296.036749:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1784045296.036880:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa94191f100 x1870706829749504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045296.036900:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829749504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045296.036992:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829748736:0@lo:400:kworker.0 00010000:00010000:0.0:1784045296.866515:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045297.575334:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045297.575371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045297.575394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045297.575420:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742400 00000100:00100000:2.0:1784045297.575428:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742400 00000100:00100000:2.0:1784045297.575474:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 284 00000100:00100000:2.0:1784045297.575484:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808742400:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045297.575563:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808742400:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045297.575571:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 284 00000100:00100000:2.0:1784045297.575693:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742656 00000100:00100000:2.0:1784045297.575697:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742656 00000100:00100000:2.0:1784045297.575744:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742528 00000100:00100000:2.0:1784045297.575748:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742528 00000100:00100000:2.0:1784045297.575780:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:2.0:1784045297.575786:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808742656:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045297.575821:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808742656:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045297.576646:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00080000:2.0:1784045297.576698:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045297.578199:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:2.0:1784045297.578231:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808742528:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045297.578312:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808742528:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 102us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045297.578319:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000001:00100000:3.0:1784045297.690041:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:3.0:1784045297.690049:0:6626:0:(genops.c:906:class_export_put()) final put ffff8aa93a1eb800/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:0.0:1784045297.690498:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93a1eb800/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 for lustre-OST0000 00000020:00000080:0.0:1784045297.690547:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93a1e9800 for lustre-OST0000 00010000:00010000:2.0:1784045297.889973:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045298.913273:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045299.112374:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045299.112398:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829749632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045299.112470:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045299.112536:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749632 00000100:00100000:2.0:1784045299.112543:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749632 00000100:00100000:2.0:1784045299.112618:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784045299.112628:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829749632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045299.112663:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045299.112706:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829749632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045299.112714:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1784045299.112734:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045299.112769:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829749632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045299.938902:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045300.833618:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784045300.961597:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045301.153625:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829749760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045301.153697:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.154174:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749760 00000100:00100000:1.0:1784045301.154184:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749760 00000100:00100000:1.0:1784045301.154243:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045301.154253:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829749760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045301.154305:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045301.154356:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829749760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045301.154363:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1784045301.154430:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784045301.154464:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa92d055180 x1870706829749760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045301.154483:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829749760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045301.164952:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829750144:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165028:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045301.165087:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045301.165094:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829750016:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165116:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045301.165271:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829749888:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165313:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045301.165338:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829750400:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165360:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045301.165379:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045301.165385:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829750272:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165408:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045301.165448:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829750144 00000100:00100000:3.0:1784045301.165455:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829750144 00000100:00100000:3.0:1784045301.165502:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829750016 00000100:00100000:3.0:1784045301.165505:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829750016 00000100:00100000:3.0:1784045301.165518:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829750400 00000100:00100000:3.0:1784045301.165521:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829750400 00000100:00100000:3.0:1784045301.165537:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784045301.165545:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829750144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165596:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829750144:12345-0@lo:400:kworker.0 Request processed in 52us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045301.165604:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784045301.165621:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784045301.165627:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829750016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165655:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829750016:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045301.165661:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784045301.165672:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784045301.165678:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829750400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165707:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829750400:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045301.165722:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784045301.165767:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829750016:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165779:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829750144:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.165807:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829750400:0@lo:400:kworker.0 00000100:00080000:3.0:1784045301.165858:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045301.166372:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829749888 00000100:00100000:0.0:1784045301.166377:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829749888 00000100:00100000:0.0:1784045301.166410:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784045301.166417:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829749888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.166461:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829749888:12345-0@lo:400:kworker.0 Request processed in 44us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.166474:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784045301.166505:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829750272 00000100:00100000:0.0:1784045301.166509:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829750272 00000100:00100000:0.0:1784045301.166538:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784045301.166543:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829750272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.166574:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829750272:12345-0@lo:400:kworker.0 Request processed in 30us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.166580:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784045301.166608:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829750272:0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.166617:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829749888:0@lo:400:kworker.0 00000100:00080000:0.0:1784045301.166634:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1784045301.782424:0:11716:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:08:20 (1784045300) 00010000:00010000:1.0:1784045301.985100:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045302.698050:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045302.698092:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045302.698124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045302.698260:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808743040 00000100:00100000:3.0:1784045302.698279:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808743040 00000100:00100000:3.0:1784045302.698349:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742912 00000100:00100000:3.0:1784045302.698354:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742912 00000100:00100000:3.0:1784045302.698377:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:3.0:1784045302.698387:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2361:x1870706808743040:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:2.0:1784045302.698621:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045302.698653:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:2.0:1784045302.698662:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2361:x1870706808742912:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045302.698738:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2361:x1870706808742912:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045302.698745:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:3.0:1784045302.699141:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2361:x1870706808743040:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 755us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045302.699149:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:1.0:1784045302.701052:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808742784 00000100:00100000:1.0:1784045302.701064:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808742784 00000100:00100000:1.0:1784045302.701112:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 286 00000100:00100000:1.0:1784045302.701120:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808742784:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045302.701195:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808742784:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 74us (3163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045302.717815:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 286 00010000:00010000:0.0:1784045303.009435:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045303.175383:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045303.175470:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808743168 00000100:00100000:3.0:1784045303.175486:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808743168 00000100:00100000:3.0:1784045303.175542:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784045303.175549:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:10205:x1870706808743168:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045303.175567:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045303.175585:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd54 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.175639:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cf60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.175653:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cf60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.175680:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cf60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045303.175875:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784045303.175879:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045303.175961:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cf60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.175987:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd54 expref: 7 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.176004:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cf60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd54 expref: 6 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.176012:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045303.176014:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045303.176018:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045303.176168:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:10205:x1870706808743168:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 617us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045303.176176:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784045303.185930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045303.186029:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808743296 00000100:00100000:2.0:1784045303.186048:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808743296 00000100:00100000:2.0:1784045303.186117:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:2.0:1784045303.186128:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:10206:x1870706808743296:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045303.186149:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045303.186170:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2cf67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd5b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.186246:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.186261:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.186461:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.186489:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.186515:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.186719:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.187802:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2cf7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.187818:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.187855:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045303.187955:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784045303.187959:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045303.188058:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188072:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188079:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188086:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188093:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045303.188098:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188113:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188129:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045303.188132:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045303.188137:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188143:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2cf6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188155:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188161:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188166:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188171:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045303.188174:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188180:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188187:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8aa902ec0400) 00010000:00010000:2.0:1784045303.188189:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045303.188192:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188208:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2cf75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.188255:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2cf67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd5b expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.189673:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2cf7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd5b expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045303.189686:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045303.189689:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045303.189693:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721a00, rc 0) 00000100:00100000:2.0:1784045303.189777:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:10206:x1870706808743296:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 3650us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045303.189787:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1784045303.192736:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045303.197747:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808743552 00000100:00100000:3.0:1784045303.197763:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808743552 00000100:00100000:3.0:1784045303.197855:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784045303.197865:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:10206:x1870706808743552:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045303.197888:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045303.197912:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd62 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.198013:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.198041:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.198053:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.198110:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.198118:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.198124:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.199825:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2cf98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200097:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2cf98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200107:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2cf98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045303.200119:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1784045303.200345:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200353:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200367:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200373:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045303.200378:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200385:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200398:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:3.0:1784045303.200402:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045303.200406:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200412:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cf8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200426:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200432:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200437:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200442:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045303.200445:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200462:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200471:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8aa92210c700) 00010000:00010000:3.0:1784045303.200473:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045303.200476:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.200765:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cf91 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.204824:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2cf83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd62 expref: 10 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.204872:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2cf98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd62 expref: 9 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045303.204881:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:3.0:1784045303.204884:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045303.204888:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f000, rc 0) 00000100:00100000:3.0:1784045303.204971:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10206:x1870706808743552:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 7105us (12241us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784045303.204980:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784045303.214267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045303.217954:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808743680 00000100:00100000:1.0:1784045303.217970:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808743680 00000100:00100000:1.0:1784045303.218176:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784045303.218189:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10206:x1870706808743680:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784045303.218329:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10206:x1870706808743680:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 142us (4071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045303.218337:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000040:00080000:1.0:1784045303.905489:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784045304.034255:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045304.232395:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829750528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045304.232470:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045304.232956:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829750528 00000100:00100000:3.0:1784045304.232965:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829750528 00000100:00100000:3.0:1784045304.233042:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045304.233051:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829750528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045304.233104:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045304.233160:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829750528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045304.233167:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045304.233220:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829750528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784045304.233575:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045305.061693:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045305.433935:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045305.433967:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808743808 00000100:00100000:3.0:1784045305.433977:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808743808 00000100:00100000:3.0:1784045305.434033:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1784045305.434055:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10248:x1870706808743808:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045305.434077:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045305.434099:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd69 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434161:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434175:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434199:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434215:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434223:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434240:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434504:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434512:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434518:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434524:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045305.434529:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434536:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434550:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045305.434553:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045305.434557:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434564:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cfad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434576:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434582:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434594:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434599:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045305.434602:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434608:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434616:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8aa92210c600) 00010000:00010000:3.0:1784045305.434618:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045305.434622:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434627:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434660:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cfa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd69 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434670:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045305.434672:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045305.434675:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd69 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.434683:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f400, rc 0) 00000100:00100000:3.0:1784045305.434741:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10248:x1870706808743808:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 699us (811us total) trans 0 rc 301/301 00000100:00100000:3.0:1784045305.434757:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00080000:3.0:1784045305.434781:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045305.438709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045305.439074:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744064 00000100:00100000:3.0:1784045305.439086:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744064 00000100:00100000:3.0:1784045305.439139:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:3.0:1784045305.439148:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10248:x1870706808744064:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:3.0:1784045305.439215:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045305.439242:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2cf60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd54 expref: 9 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.439262:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045305.439274:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045305.442259:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.442281:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.442294:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.442307:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.442319:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.442326:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045305.443316:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784045305.443329:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.443337:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.443350:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.443357:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045305.443361:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.443369:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.443385:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa902ec0500) 00010000:00010000:2.0:1784045305.443389:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045305.443393:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.443400:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2cfbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045305.443432:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dcde51d reply state 0000000066924d0b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045305.443442:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045305.443758:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:10248:x1870706808744064:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 4605us (5054us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784045305.443767:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00010000:00010000:1.0:1784045305.449932:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.449970:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.449978:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.449984:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045305.449989:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.449997:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.450015:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8aa902ec0300) 00010000:00010000:1.0:1784045305.450019:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045305.450023:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.450030:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2cfc2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045305.550980:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045305.551128:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744192 00000100:00100000:3.0:1784045305.551139:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744192 00000100:00100000:3.0:1784045305.551220:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1784045305.551232:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:10256:x1870706808744192:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:3.0:1784045305.551258:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045305.551293:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cfc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd70 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.551363:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.551377:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.551389:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045305.551474:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784045305.551478:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045305.551521:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.551548:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cfc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd70 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.551569:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd70 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.551578:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045305.551581:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045305.551585:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f600, rc 0) 00000100:00100000:3.0:1784045305.551652:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:10256:x1870706808744192:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 423us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045305.551660:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1784045305.640092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045305.640232:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744320 00000100:00100000:1.0:1784045305.640241:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744320 00000100:00100000:1.0:1784045305.640304:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1784045305.640314:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:10262:x1870706808744320:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784045305.640334:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045305.640355:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cfd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd77 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640451:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640465:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640484:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640500:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640510:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640515:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640655:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cfec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640663:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cfec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640669:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cfec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045305.640700:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1784045305.640703:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045305.640742:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cfec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640763:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640769:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640775:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640781:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045305.640784:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640791:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640803:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045305.640806:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045305.640811:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640816:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2cfde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640872:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640879:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640884:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640897:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045305.640900:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640906:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640914:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8aa91040da00) 00010000:00010000:1.0:1784045305.640916:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045305.640919:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640925:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2cfe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640956:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2cfd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd77 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640969:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cfec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd77 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.640975:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045305.640977:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784045305.640980:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361c00, rc 0) 00000100:00100000:1.0:1784045305.641045:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:10262:x1870706808744320:12345-192.168.201.58@tcp:101:bash.0 Request processed in 731us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045305.641053:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784045305.645927:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045305.646183:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744576 00000100:00100000:3.0:1784045305.646205:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744576 00000100:00100000:3.0:1784045305.646272:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1784045305.646297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:10262:x1870706808744576:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045305.646320:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045305.646342:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cff3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd7e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.646475:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.646502:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.646514:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.646572:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.646581:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.646586:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045305.647200:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784045305.647383:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647396:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647403:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647439:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647446:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647452:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647466:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045305.647471:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647478:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647491:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045305.647494:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045305.647499:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647505:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2cffa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045305.647519:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6d9c409 reply state 0000000058215020 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045305.647527:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784045305.647556:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2cff3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647572:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.647579:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:3.0:1784045305.647581:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045305.647584:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ec00, rc 0) 00000100:00100000:3.0:1784045305.647665:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10262:x1870706808744576:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1384us (1747us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784045305.647682:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:0.0:1784045305.660006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:2.0:1784045305.660138:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.660153:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.660161:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.660168:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ea00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045305.660173:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.660181:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.660213:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa92210c600) 00010000:00010000:2.0:1784045305.660216:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045305.660221:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045305.660242:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d001 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045305.664904:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744704 00000100:00100000:3.0:1784045305.664922:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744704 00000100:00100000:3.0:1784045305.664978:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784045305.664987:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1870706808744704:12345-192.168.201.58@tcp:8:bash.0 00010000:00080000:3.0:1784045305.665022:0:8930:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:3.0:1784045305.665056:0:8930:0:(genops.c:1406:class_connect()) connect: client 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1, cookie 0xdb5b5ff6a2d2d016 00002000:00100000:3.0:1784045305.665069:0:8930:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1/ffff8aa939d5e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784045305.665094:0:8930:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784045305.665379:0:8930:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784045305.665412:0:8930:0:(import.c:65:import_set_state_nolock()) ffff8aa939d5f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045305.665500:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2359:x1870706808744704:12345-192.168.201.58@tcp:8:bash.0 Request processed in 512us (5503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045305.665508:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1784045305.668816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045305.669138:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744832 00000100:00100000:0.0:1784045305.669149:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744832 00000100:00100000:0.0:1784045305.669240:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:0.0:1784045305.669252:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:0:x1870706808744832:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045305.669271:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045305.669310:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd85 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045305.669350:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045305.669369:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1784045305.669373:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045305.669383:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.669402:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.669415:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32200, rc 0) 00000100:00100000:0.0:1784045305.669472:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:0:x1870706808744832:12345-192.168.201.58@tcp:101:bash.0 Request processed in 222us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045305.669480:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00080000:3.0:1784045305.669735:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045305.677495:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045305.677575:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808744960 00000100:00100000:3.0:1784045305.677585:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808744960 00000100:00100000:3.0:1784045305.677638:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:3.0:1784045305.677647:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:10262:x1870706808744960:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045305.677665:0:8930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045305.677687:0:8930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd8c expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.677718:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.677739:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045305.677744:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045305.677750:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 8 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.677784:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.677798:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 8 pid: 6598 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045305.677812:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d055500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8930:1870706829750656:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045305.677945:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045305.682453:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045305.682550:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808745088 00000100:00100000:1.0:1784045305.682559:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808745088 00010000:00010000:1.0:1784045305.682601:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 9 pid: 6598 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045305.682649:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784045305.682660:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2361:x1870706808745088:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045305.682675:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045305.682700:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 9 pid: 6598 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.682717:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 9 pid: 6598 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.682749:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045305.682754:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045305.682763:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.682774:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.682813:0:7497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045305.682963:0:7497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7497:1870706829750784:192.168.201.58@tcp:105: 00010000:00010000:3.0:1784045305.683146:0:8930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d01d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd85 expref: 9 pid: 6598 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045305.683162:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d055500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8930:1870706829750656:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045305.683202:0:8930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 8 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.683213:0:8930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ea00, rc 0) 00000100:00100000:1.0:1784045305.683272:0:7497:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045305.688151:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:10262:x1870706808744960:12345-192.168.201.58@tcp:101:bash.0 Request processed in 10492us (10653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045305.688201:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:0.0:1784045305.706623:0:7497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7497:1870706829750784:192.168.201.58@tcp:105: 00010000:00010000:0.0:1784045305.706652:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045305.706716:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808745088:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 24057us (24269us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045305.706728:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:2.0:1784045305.712054:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045305.712168:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808745344 00000100:00100000:0.0:1784045305.712179:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808745344 00000100:00100000:0.0:1784045305.712252:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784045305.712263:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10262:x1870706808745344:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1784045305.712668:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10262:x1870706808745344:12345-192.168.201.58@tcp:35:bash.0 Request processed in 406us (624us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784045305.712691:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000001:00100000:3.0:1784045305.785402:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000100:00100000:2.0:1784045305.847977:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045305.848371:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808745600 00000100:00100000:1.0:1784045305.848381:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808745600 00000100:00100000:1.0:1784045305.848449:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784045305.848461:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10272:x1870706808745600:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045305.848486:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045305.848506:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd93 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045305.848633:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1784045305.848774:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d02b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd93 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.848790:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045305.848793:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045305.848949:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd93 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.848967:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360800, rc 0) 00000100:00100000:1.0:1784045305.849037:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10272:x1870706808745600:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 577us (1069us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1784045305.849045:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784045305.857113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045305.857627:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808745856 00000100:00100000:0.0:1784045305.857641:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808745856 00000100:00100000:0.0:1784045305.857769:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784045305.857782:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10272:x1870706808745856:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045305.858248:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10272:x1870706808745856:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 467us (1149us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784045305.858257:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1784045305.957547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045305.957766:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808745984 00000100:00100000:0.0:1784045305.957776:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808745984 00000100:00100000:0.0:1784045305.957872:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784045305.957883:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10278:x1870706808745984:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045305.957908:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045305.957930:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffd9a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.958010:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.958024:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.958035:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045305.958097:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1784045305.958101:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045305.958143:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.958171:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd9a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.958226:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd9a expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.958236:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045305.958239:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045305.958243:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33200, rc 0) 00000100:00100000:0.0:1784045305.958315:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10278:x1870706808745984:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 434us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045305.958323:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1784045305.973144:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045305.974019:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808746240 00000100:00100000:1.0:1784045305.974032:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808746240 00000100:00100000:1.0:1784045305.974115:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784045305.974128:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10278:x1870706808746240:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045305.974176:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045305.974216:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffda1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.974364:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d04e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.974382:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.974398:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045305.974413:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784045305.974580:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda1 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.975089:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d04e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda1 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045305.975100:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:1.0:1784045305.975103:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045305.975106:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361a00, rc 0) 00000100:00100000:1.0:1784045305.975199:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10278:x1870706808746240:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1073us (2070us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1784045305.975208:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784045305.989758:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045305.989802:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045305.989950:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808746368 00000100:00100000:0.0:1784045305.989961:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808746368 00000100:00100000:0.0:1784045305.990048:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784045305.990059:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:2361:x1870706808746368:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045305.990075:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045305.990102:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d04e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda1 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045305.990121:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045305.990126:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045305.990207:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:2361:x1870706808746368:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 150us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045305.990215:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784045305.992552:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808746624 00000100:00100000:3.0:1784045305.992566:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808746624 00000100:00100000:3.0:1784045305.992639:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:3.0:1784045305.992649:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10278:x1870706808746624:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045305.992675:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045305.992696:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d05c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffda8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.992796:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d063 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.992810:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d063 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.992822:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d063 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045305.992871:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784045305.993013:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d05c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda8 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.993035:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d063 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda8 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045305.993044:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:3.0:1784045305.993059:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045305.993063:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148e000, rc 0) 00000100:00100000:3.0:1784045305.993128:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:10278:x1870706808746624:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 480us (3323us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1784045305.993135:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:1.0:1784045306.007606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.007804:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808746752 00000100:00100000:0.0:1784045306.007815:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808746752 00000100:00100000:0.0:1784045306.007910:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1784045306.007921:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808746752:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:0.0:1784045306.007984:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.008005:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.008013:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045306.008017:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045306.008021:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.008057:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.008071:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 6 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045306.008086:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1870706829750912:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045306.008198:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa912523d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045306.011574:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045306.011739:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808746880 00000100:00100000:3.0:1784045306.011748:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808746880 00002000:00100000:3.0:1784045306.011795:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8aa941d0ea00 x1870706808746880/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:702/0 lens 504/0 e 0 to 0 dl 1784045317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045306.011807:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa941d0ea00 with x1870706808746880 ext(0->12) 00010000:00010000:3.0:1784045306.011816:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 7 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.011869:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 7 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045306.011879:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa941d0ea00 00000100:00100000:3.0:1784045306.011902:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784045306.011914:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808746880:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:0.0:1784045306.013099:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d30700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1870706829750912:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045306.013124:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045306.013761:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2361:x1870706808746880:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 1845us (2193us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784045306.013776:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00002000:00100000:2.0:1784045306.013786:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8aa941d0ea00 x1870706808746880/t4294967299(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:702/0 lens 504/448 e 0 to 0 dl 1784045317 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045306.013795:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa941d0ea00 with x1870706808746880 ext(0->12) 00010000:00010000:2.0:1784045306.013803:0:6603:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045306.013817:0:6603:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045306.013825:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa941d0ea00 00000100:00100000:2.0:1784045306.026949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.027168:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808747008 00000100:00100000:0.0:1784045306.027189:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808747008 00010000:00010000:0.0:1784045306.027233:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045306.027282:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:0.0:1784045306.027292:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2362:x1870706808747008:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045306.027308:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784045306.027329:0:5789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784045306.027332:0:5789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784045305 00002000:00010000:0.0:1784045306.027334:0:5789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784045306 00002000:00010000:0.0:1784045306.027336:0:5789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784045305 00010000:00010000:0.0:1784045306.027342:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.027357:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.027381:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c42add2e/0xdb5b5ff6a2d2d024 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd8c expref: 9 pid: 8930 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.027399:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045306.027402:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045306.027408:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.027432:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.027471:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045306.027776:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027787:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027812:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027821:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027867:0:6598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027876:0:6598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045306.027879:0:6598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027888:0:6598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027900:0:6598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.027907:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d071 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045306.028006:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2363:x1870706808746752:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 20086us (20411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045306.028015:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1784045306.028316:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2362:x1870706808747008:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1024us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045306.028324:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:1.0:1784045306.034226:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045306.034464:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808747264 00000100:00100000:3.0:1784045306.034475:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808747264 00000100:00100000:3.0:1784045306.034552:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784045306.034563:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:10278:x1870706808747264:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:3.0:1784045306.034642:0:5807:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d063 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda8 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045306.035016:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1784045306.035071:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1784045306.035743:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1784045306.035806:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.035826:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.035864:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.035902:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.035918:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 24 pid: 5804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045306.035932:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1870706829751040:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045306.036022:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b600 going to sleep for 11 seconds 00000100:00100000:2.0:1784045306.039255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.039510:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808747392 00000100:00100000:0.0:1784045306.039519:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808747392 00010000:00010000:0.0:1784045306.039560:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 25 pid: 5804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045306.039606:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:0.0:1784045306.039615:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:2360:x1870706808747392:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045306.039629:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045306.039636:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 25 pid: 5804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.039649:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 25 pid: 5804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.039670:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045306.039675:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.039683:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.039704:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.039721:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045306.039770:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:2360:x1870706808747392:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 155us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045306.039778:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00010000:00010000:3.0:1784045306.040051:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd7e expref: 24 pid: 5804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045306.040068:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1870706829751040:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045306.040090:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.040109:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.040116:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045306.040368:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1784045306.040626:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1784045306.040730:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1870706829751168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784045306.040825:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045306.041892:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045306.045699:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751168 00000100:00100000:2.0:1784045306.045714:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751168 00000100:00100000:2.0:1784045306.045804:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045306.045815:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1870706829751168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784045306.046018:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1870706829751168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 204us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.046027:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784045306.046106:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045306.046161:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1870706829751168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784045306.046916:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1784045306.046994:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1870706829751296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784045306.047052:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045306.047091:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b600 going to sleep for 11 seconds 00000100:00100000:2.0:1784045306.047638:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751296 00000100:00100000:2.0:1784045306.047646:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751296 00000100:00100000:2.0:1784045306.047683:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045306.047690:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1870706829751296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784045306.047917:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1870706829751296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 225us (864us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784045306.047925:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045306.048632:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d056300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1870706829751296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784045306.048689:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1784045306.048728:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.048738:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.048746:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.048761:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045306.048766:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.048773:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.048788:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:3.0:1784045306.048791:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784045306.048795:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.048801:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d078 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045306.048982:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784045306.049327:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1784045306.049340:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340735509020ns, next at 341735505575ns, rc = 0 00000001:00080000:3.0:1784045306.049347:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1784045306.049381:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:3.0:1784045306.049384:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045306.049392:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d063 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffda8 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045306.049621:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:10278:x1870706808747264:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 15059us (15403us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1784045306.049630:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000020:00080000:3.0:1784045306.049634:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784045306.053480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045306.054320:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808747520 00000100:00100000:1.0:1784045306.054331:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808747520 00000100:00100000:1.0:1784045306.054398:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1784045306.054408:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:10278:x1870706808747520:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045306.054434:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045306.054460:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d07f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdaf expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.054531:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d07f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdaf expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.054547:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d07f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdaf expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.054568:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045306.054571:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045306.054575:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361a00, rc 0) 00000100:00100000:1.0:1784045306.054646:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:10278:x1870706808747520:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 239us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045306.054654:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1784045306.060427:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.060522:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808747776 00000100:00100000:0.0:1784045306.060532:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808747776 00000100:00100000:0.0:1784045306.060592:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1784045306.060603:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:10278:x1870706808747776:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045306.060871:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:10278:x1870706808747776:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 269us (454us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1784045306.060879:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00010000:00010000:2.0:1784045306.081229:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045306.162009:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.166058:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808748032 00000100:00100000:0.0:1784045306.166072:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808748032 00000100:00100000:0.0:1784045306.166155:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784045306.166166:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:10288:x1870706808748032:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045306.166219:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045306.166247:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdb6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045306.166369:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784045306.166492:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d086 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdb6 expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.166525:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045306.166528:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045306.166535:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdb6 expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.166555:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32a00, rc 0) 00000100:00100000:0.0:1784045306.166624:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:10288:x1870706808748032:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 460us (4624us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1784045306.166631:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:2.0:1784045306.178463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045306.178568:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808748160 00000100:00100000:1.0:1784045306.178590:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808748160 00000100:00100000:1.0:1784045306.178653:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1784045306.178663:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:10288:x1870706808748160:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:1.0:1784045306.178745:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178763:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178774:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178788:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178795:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178801:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178924:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178932:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.178940:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045306.178991:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179014:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179021:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179028:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179035:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045306.179039:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179046:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179058:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045306.179061:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045306.179066:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179071:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179084:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179090:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179095:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179106:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045306.179109:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179115:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179123:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa91040d200) 00010000:00010000:1.0:1784045306.179126:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045306.179129:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179134:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d09b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179147:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179154:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179159:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179163:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045306.179166:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179171:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179200:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045306.179202:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045306.179206:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.179211:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d0a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045306.179380:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:10288:x1870706808748160:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 717us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045306.179389:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1784045306.184879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.186171:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808748416 00000100:00100000:0.0:1784045306.186196:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808748416 00000100:00100000:0.0:1784045306.186256:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784045306.186266:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:10288:x1870706808748416:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045306.186528:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:10288:x1870706808748416:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 263us (1658us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1784045306.186536:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784045306.225323:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.225427:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808748672 00000100:00100000:0.0:1784045306.225437:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808748672 00000100:00100000:0.0:1784045306.225495:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784045306.225506:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:10291:x1870706808748672:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045306.225541:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045306.225562:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d0a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdbd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225636:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225660:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225668:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225678:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225682:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225686:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225802:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225810:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225817:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045306.225860:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784045306.225946:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225952:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225956:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225965:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045306.225974:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225981:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225990:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045306.225992:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045306.225995:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.225999:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d0b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226008:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226011:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226015:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226018:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045306.226019:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226023:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226034:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5600) 00010000:00010000:0.0:1784045306.226035:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045306.226037:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226040:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226070:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d0a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226077:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.226082:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:0.0:1784045306.226083:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045306.226085:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32e00, rc 0) 00000100:00100000:0.0:1784045306.226133:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10291:x1870706808748672:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 631us (822us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1784045306.226139:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:2.0:1784045306.228173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045306.228470:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808748800 00000100:00100000:3.0:1784045306.228478:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808748800 00000100:00100000:3.0:1784045306.228534:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:3.0:1784045306.228544:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10291:x1870706808748800:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784045306.228608:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228620:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228627:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228646:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228650:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228654:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228658:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045306.228660:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228665:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228671:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045306.228683:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045306.228686:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.228690:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045306.228752:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10291:x1870706808748800:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 209us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045306.228760:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784045306.231492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.231736:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808749056 00000100:00100000:0.0:1784045306.231745:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808749056 00000100:00100000:0.0:1784045306.231797:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1784045306.231806:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10291:x1870706808749056:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045306.232125:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:10291:x1870706808749056:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 319us (640us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1784045306.232132:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784045306.273685:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045306.273757:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045306.273975:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829751808:0@lo:400:kworker.0 00000100:00100000:3.0:1784045306.274001:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045306.274019:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045306.274023:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829751936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045306.274038:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045306.274061:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751936 00000100:00100000:3.0:1784045306.274067:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751936 00000100:00100000:3.0:1784045306.274109:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045306.274116:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045306.274158:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829751936:12345-0@lo:400:kworker.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045306.274165:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1784045306.274195:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045306.274237:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829751936:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274421:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829751680:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274461:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045306.274490:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784045306.274496:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829751552:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274523:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045306.274543:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829752064:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274564:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045306.274592:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751808 00000100:00100000:0.0:1784045306.274596:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751808 00000100:00100000:0.0:1784045306.274624:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751680 00000100:00100000:0.0:1784045306.274626:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751680 00000100:00100000:0.0:1784045306.274637:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829752064 00000100:00100000:0.0:1784045306.274638:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829752064 00000100:00100000:0.0:1784045306.274652:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784045306.274658:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829751808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274695:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829751808:12345-0@lo:400:kworker.0 Request processed in 37us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045306.274701:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784045306.274714:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784045306.274720:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829751680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274752:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829751680:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045306.274757:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784045306.274769:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784045306.274775:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829752064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274801:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829752064:12345-0@lo:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045306.274823:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784045306.274878:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829752064:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.274888:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829751680:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.275003:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751552 00000100:00100000:2.0:1784045306.275007:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751552 00000100:00100000:2.0:1784045306.275035:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784045306.275039:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829751552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.275067:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829751552:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.275071:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784045306.275102:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829751552:0@lo:400:kworker.0 00000100:00100000:1.0:1784045306.275421:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829751424 00000100:00100000:1.0:1784045306.275425:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829751424 00000100:00100000:1.0:1784045306.275471:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045306.275479:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829751424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045306.275495:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045306.275537:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829751424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045306.275544:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045306.275574:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829751424:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784045306.277102:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045306.277167:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829751808:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.748722:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045306.748858:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808749312 00000100:00100000:2.0:1784045306.748869:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808749312 00000100:00100000:2.0:1784045306.748943:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:2.0:1784045306.748954:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:10322:x1870706808749312:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:2.0:1784045306.749000:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045306.749023:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d0d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdc4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045306.749126:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d0da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045306.749140:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045306.749153:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045306.749164:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784045306.749321:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d0d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdc4 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045306.749343:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d0da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdc4 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045306.749351:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045306.749354:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045306.749357:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045306.749709:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:10322:x1870706808749312:12345-192.168.201.58@tcp:101:cat.0 Request processed in 755us (1006us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1784045306.749730:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:2.0:1784045306.758934:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045306.759007:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045306.760111:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808749696 00000100:00100000:1.0:1784045306.760126:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808749696 00000100:00100000:1.0:1784045306.760220:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1784045306.760231:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907eea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:2362:x1870706808749696:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045306.760248:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045306.760275:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d0da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdc4 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045306.760317:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045306.760322:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045306.760395:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907eea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:2362:x1870706808749696:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 165us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045306.760404:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1784045306.761226:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808749568 00000100:00100000:0.0:1784045306.761234:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808749568 00000100:00100000:0.0:1784045306.761284:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784045306.761292:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:10322:x1870706808749568:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1784045306.761596:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:10322:x1870706808749568:12345-192.168.201.58@tcp:35:cat.0 Request processed in 304us (2675us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784045306.761603:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1784045306.871648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045306.871747:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808749952 00000100:00100000:3.0:1784045306.871771:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808749952 00000100:00100000:3.0:1784045306.871876:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1784045306.871887:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:10328:x1870706808749952:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:3.0:1784045306.871912:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045306.871915:0:7507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045306.871943:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd9a expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.871972:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045306.871978:0:7507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045306.871992:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdcb expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.872111:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.872125:0:7507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.872135:0:7507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.872181:0:7507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.872195:0:7507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 36 pid: 5804 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045306.872401:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829752192:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045306.872559:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045306.887675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.887950:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808750080 00000100:00100000:0.0:1784045306.887973:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808750080 00010000:00010000:0.0:1784045306.888019:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 37 pid: 5804 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045306.888064:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784045306.888074:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:2360:x1870706808750080:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045306.888089:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045306.888096:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 37 pid: 5804 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.888109:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 37 pid: 5804 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.888152:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:0.0:1784045306.888157:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.888178:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.888188:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.888232:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045306.888302:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:2360:x1870706808750080:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 228us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045306.888311:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00010000:00010000:3.0:1784045306.889276:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d0be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdbd expref: 36 pid: 5804 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045306.889543:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829752192:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045306.889565:0:7507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.889574:0:7507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.889580:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045306.889601:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784045306.889768:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d0e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 37 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.890143:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 36 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.890154:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045306.890158:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045306.890161:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f400, rc 0) 00000100:00100000:2.0:1784045306.896306:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:10328:x1870706808749952:12345-192.168.201.58@tcp:101:dd.0 Request processed in 24395us (24643us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1784045306.896320:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784045306.908127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045306.908321:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808750336 00000100:00100000:0.0:1784045306.908331:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808750336 00000100:00100000:0.0:1784045306.908393:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784045306.908403:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:10328:x1870706808750336:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1784045306.908728:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.908749:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045306.908761:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045306.910990:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1784045306.911096:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d71cfb2b reply state 0000000084e3803d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045306.911121:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045306.911274:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:10328:x1870706808750336:12345-192.168.201.58@tcp:36:dd.0 Request processed in 2867us (3152us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784045306.911284:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000020:00080000:0.0:1784045306.911290:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045306.924963:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.924983:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.925018:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.925023:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045306.925029:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.925037:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.925054:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045306.925057:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045306.925061:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045306.925067:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d0fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.105136:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045307.281340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045307.281458:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808750464 00000100:00100000:0.0:1784045307.281469:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808750464 00000100:00100000:0.0:1784045307.281548:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:0.0:1784045307.281559:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:10342:x1870706808750464:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:0.0:1784045307.281584:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045307.281605:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdd2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281673:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281687:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281699:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281714:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281721:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281728:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281897:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281909:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 39 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281918:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281953:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 39 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.281966:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 39 pid: 7507 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045307.281980:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829752320:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045307.282061:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9061f19c0 going to sleep for 11 seconds 00000100:00080000:3.0:1784045307.282383:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045307.284551:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.284758:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808750720 00000100:00100000:2.0:1784045307.284768:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808750720 00000100:00100000:2.0:1784045307.284826:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784045307.284863:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:6038:x1870706808750720:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784045307.285197:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:6038:x1870706808750720:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 335us (664us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1784045307.285206:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784045307.285476:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829752320:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045307.285513:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045307.288999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045307.289141:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808750848 00000100:00100000:0.0:1784045307.289150:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808750848 00010000:00010000:0.0:1784045307.289213:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 41 pid: 7507 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045307.289257:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:0.0:1784045307.289267:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:2361:x1870706808750848:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045307.289284:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045307.289291:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 41 pid: 7507 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.289317:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 41 pid: 7507 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.289339:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d0ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdcb expref: 41 pid: 7507 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.289359:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:0.0:1784045307.289365:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.289375:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.289382:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.289425:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045307.289487:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:2361:x1870706808750848:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 220us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045307.289495:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00010000:00010000:3.0:1784045307.290639:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290653:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045307.290712:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784045307.290727:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045307.290781:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290795:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290805:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290812:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290818:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290823:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045307.290861:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290870:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290883:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045307.290887:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045307.290891:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290897:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d10b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290924:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290941:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290948:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290958:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045307.290962:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290969:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290978:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5600) 00010000:00010000:3.0:1784045307.290981:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045307.290984:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.290991:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.291031:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd2 expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.291045:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd2 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.291052:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045307.291054:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045307.291062:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32400, rc 0) 00000100:00100000:3.0:1784045307.291122:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:10342:x1870706808750464:12345-192.168.201.58@tcp:101:stat.0 Request processed in 9564us (9790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045307.291130:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1784045307.369167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.369237:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808751104 00000100:00100000:2.0:1784045307.369247:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808751104 00000100:00100000:2.0:1784045307.369301:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:2.0:1784045307.369309:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:10348:x1870706808751104:12345-192.168.201.58@tcp:36:truncate.0 00010000:00010000:2.0:1784045307.369376:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045307.369405:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd2 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.369443:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.369449:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045307.369665:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.369680:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.369690:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045307.369736:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1784045307.369755:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000450806a6 reply state 00000000f80e3c51 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045307.369764:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045307.369904:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:10348:x1870706808751104:12345-192.168.201.58@tcp:36:truncate.0 Request processed in 595us (755us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1784045307.369912:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000020:00080000:2.0:1784045307.369916:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784045307.372202:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.372219:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.372227:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.372233:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045307.372251:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.372259:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.372275:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.372278:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045307.372282:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.372289:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d120 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045307.548780:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.548903:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808751232 00000100:00100000:2.0:1784045307.548913:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808751232 00000100:00100000:2.0:1784045307.548977:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1784045307.548987:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:10362:x1870706808751232:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:2.0:1784045307.549010:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045307.549031:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdd9 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549099:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549113:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549124:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549139:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549172:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549179:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549279:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549289:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549296:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045307.549337:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1784045307.549341:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045307.549365:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549377:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549385:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549391:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549397:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549415:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045307.549420:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549429:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549441:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:2.0:1784045307.549444:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045307.549448:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549453:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d12e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549482:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549488:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549494:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549499:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045307.549501:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549506:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549524:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa902ec0800) 00010000:00010000:2.0:1784045307.549527:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045307.549529:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549545:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549574:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 42 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549587:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 41 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.549594:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.549596:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045307.549598:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045307.549666:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:10362:x1870706808751232:12345-192.168.201.58@tcp:101:stat.0 Request processed in 680us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045307.549674:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:0.0:1784045307.646276:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.646400:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808751488 00000100:00100000:2.0:1784045307.646411:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808751488 00000100:00100000:2.0:1784045307.646476:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:2.0:1784045307.646488:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:10372:x1870706808751488:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045307.646508:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045307.646527:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffde0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045307.646661:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784045307.646797:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d143 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde0 expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.646811:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045307.646814:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045307.646819:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde0 expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.646868:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720600, rc 0) 00000100:00100000:2.0:1784045307.646934:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:10372:x1870706808751488:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 449us (668us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1784045307.646941:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:0.0:1784045307.650938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.651049:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808751744 00000100:00100000:2.0:1784045307.651060:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808751744 00000100:00100000:2.0:1784045307.651177:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1784045307.651187:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:10372:x1870706808751744:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045307.651453:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:10372:x1870706808751744:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 267us (522us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1784045307.651461:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784045307.723507:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.723808:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808752000 00000100:00100000:2.0:1784045307.723823:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808752000 00000100:00100000:2.0:1784045307.724273:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:2.0:1784045307.724286:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:10378:x1870706808752000:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045307.724317:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045307.724360:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d151 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffde7 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.724606:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.724624:0:7507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 44 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.724634:0:7507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.724678:0:7507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 44 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.724693:0:7507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 44 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045307.724708:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa907f7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829752448:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045307.724890:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9055df300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045307.730766:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.730908:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa907f7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829752448:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045307.730959:0:7507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045307.731192:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808752128 00000100:00100000:3.0:1784045307.731281:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808752128 00010000:00010000:3.0:1784045307.731330:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 45 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045307.731374:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1784045307.731385:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+45:2361:x1870706808752128:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045307.731404:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045307.731412:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 45 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.731488:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 45 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.731515:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d13c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdd9 expref: 45 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.731537:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045307.731541:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.731553:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.731562:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.731653:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045307.731724:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:2361:x1870706808752128:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 340us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045307.731732:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00010000:00010000:2.0:1784045307.733355:0:7507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.733374:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045307.733481:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1784045307.733714:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d151 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 45 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.733736:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 44 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.733745:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.733748:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045307.733752:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721600, rc 0) 00000100:00100000:2.0:1784045307.733909:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:10378:x1870706808752000:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9624us (10415us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1784045307.733919:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:0.0:1784045307.737909:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.738066:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808752384 00000100:00100000:2.0:1784045307.738079:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808752384 00000100:00100000:2.0:1784045307.738166:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:2.0:1784045307.738179:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:10378:x1870706808752384:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:2.0:1784045307.738576:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.738601:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.738616:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045307.738677:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1784045307.738713:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0827843 reply state 000000004a2a5974 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045307.738725:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045307.738864:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:10378:x1870706808752384:12345-192.168.201.58@tcp:36:bash.0 Request processed in 686us (968us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1784045307.738873:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000020:00080000:2.0:1784045307.738879:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784045307.742537:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.742561:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.742570:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.742577:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045307.742582:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.742591:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.742614:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.742617:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045307.742623:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.742630:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d166 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045307.750315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045307.750435:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808752512 00000100:00100000:3.0:1784045307.750448:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808752512 00000100:00100000:3.0:1784045307.750527:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:3.0:1784045307.750540:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+46:10378:x1870706808752512:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045307.750573:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045307.750601:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d16d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdee expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.750937:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.750969:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 47 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.750980:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.751028:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 47 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045307.751046:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 47 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045307.751181:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829752576:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045307.751372:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045307.755718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.755884:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808752640 00000100:00100000:2.0:1784045307.755915:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808752640 00010000:00010000:2.0:1784045307.755981:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 48 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045307.756044:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:2.0:1784045307.756056:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+48:2360:x1870706808752640:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045307.756637:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045307.756647:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 48 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.756666:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 48 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.756709:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.756716:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.756729:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.756738:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.756765:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045307.756871:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+48:2360:x1870706808752640:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 816us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045307.756879:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00010000:00010000:1.0:1784045307.757987:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d158 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffde7 expref: 47 pid: 7507 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045307.758013:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d051180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829752576:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045307.758307:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.758319:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.758326:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045307.758392:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784045307.758398:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045307.758494:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.758562:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d16d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdee expref: 47 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.758583:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdee expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.758592:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045307.758596:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045307.758600:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ec00, rc 0) 00000100:00100000:1.0:1784045307.758784:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+46:10378:x1870706808752512:12345-192.168.201.58@tcp:101:bash.0 Request processed in 8245us (8482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.758794:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1784045307.781665:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045307.781904:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808752896 00000100:00100000:1.0:1784045307.781918:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808752896 00000100:00100000:1.0:1784045307.782002:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1784045307.782015:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+46:10378:x1870706808752896:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:1.0:1784045307.782663:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:10378:x1870706808752896:12345-192.168.201.58@tcp:35:bash.0 Request processed in 648us (1010us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784045307.782672:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1784045307.808118:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.808174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045307.808991:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808753152 00000100:00100000:1.0:1784045307.809006:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808753152 00000100:00100000:1.0:1784045307.809082:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:1.0:1784045307.809093:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808753152:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045307.809202:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808753152:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 112us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.809220:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00080000:3.0:1784045307.809368:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045307.810004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.810032:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808753280 00000100:00100000:2.0:1784045307.810037:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808753280 00000100:00100000:2.0:1784045307.810146:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:2.0:1784045307.810165:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2361:x1870706808753280:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045307.810578:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808753024 00000100:00100000:3.0:1784045307.810585:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808753024 00000100:00100000:3.0:1784045307.810627:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 288 00000100:00100000:3.0:1784045307.810636:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808753024:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045307.810699:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2361:x1870706808753280:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 535us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045307.810708:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00080000:3.0:1784045307.813243:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045307.813284:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808753024:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 2642us (5102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045307.813298:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 288 00000001:00080000:0.0:1784045307.852958:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:0.0:1784045307.853014:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000004:00080000:0.0:1784045307.853053:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1784045307.853075:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa908a4b780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1784045307.853081:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa912421400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa908a4b9c0 00000020:00080000:0.0:1784045307.853084:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa912421700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa907f71000 00000020:00080000:2.0:1784045307.853181:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1784045307.853301:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:2.0:1784045307.853323:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1784045307.853326:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93b5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829752704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784045307.853424:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045307.853607:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829752704 00000100:00100000:2.0:1784045307.853616:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829752704 00000100:00100000:2.0:1784045307.853669:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045307.853680:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1870706829752704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784045307.853813:0:6600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1784045307.853866:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a565ef9, atime: 0x6a565efa, ctime: 0x6a565ef9, blocks: 0x1 00010000:00010000:2.0:1784045307.853874:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.853891:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1784045307.853895:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045307.853901:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.853917:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.853935:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.853991:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.854012:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045307.854044:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045307.854051:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.854060:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045307.854065:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.854075:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.854096:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.854105:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d17b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.854129:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045307.854131:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045307.854139:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045307.854651:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829752704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 972us (1226us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784045307.854661:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1784045307.854664:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa93b5aaa00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1784045307.854671:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93b5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829752704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784045307.861575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045307.864297:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808753536 00000100:00100000:2.0:1784045307.864315:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808753536 00000100:00100000:2.0:1784045307.864403:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:2.0:1784045307.864415:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:10388:x1870706808753536:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045307.864449:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045307.864479:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdf5 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045307.864934:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1784045307.865290:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d182 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdf5 expref: 13 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.865309:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045307.865312:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045307.865317:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdf5 expref: 13 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.865341:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721e00, rc 0) 00000100:00100000:2.0:1784045307.865476:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:10388:x1870706808753536:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1062us (3912us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1784045307.865485:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:2.0:1784045307.867630:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045307.867739:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808753664 00000100:00100000:1.0:1784045307.867747:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808753664 00000100:00100000:1.0:1784045307.867803:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:1.0:1784045307.867813:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:10388:x1870706808753664:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:1.0:1784045307.867928:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.867954:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.867966:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.867979:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.867983:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.867988:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868361:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868371:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868379:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045307.868587:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868603:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868610:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868618:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868626:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045307.868630:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868638:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868652:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045307.868654:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045307.868659:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868665:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868678:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868685:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868696:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868702:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045307.868705:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868712:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868721:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa91040d200) 00010000:00010000:1.0:1784045307.868723:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045307.868726:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868733:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d197 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868749:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868756:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868762:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868768:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045307.868771:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868788:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868797:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045307.868800:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045307.868803:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.868809:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d19e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045307.868970:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:10388:x1870706808753664:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1156us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.868978:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1784045307.871302:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045307.871368:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808753920 00000100:00100000:3.0:1784045307.871398:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808753920 00000100:00100000:3.0:1784045307.871460:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1784045307.871470:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:10388:x1870706808753920:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045307.872482:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10388:x1870706808753920:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 1010us (1190us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1784045307.872491:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1784045307.900396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045307.900549:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808754176 00000100:00100000:1.0:1784045307.900563:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808754176 00000100:00100000:1.0:1784045307.900640:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:1.0:1784045307.900652:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10391:x1870706808754176:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045307.900686:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045307.900714:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d1a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffdfc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.900809:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.900827:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.901243:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.901800:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.901814:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.901823:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.902914:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d1ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.902929:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.902992:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045307.903008:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784045307.903144:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903163:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903171:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903178:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045307.903183:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903262:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903278:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045307.903281:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045307.903286:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903293:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d1ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903308:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903314:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903320:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903325:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045307.903329:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903335:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903342:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5f00) 00010000:00010000:0.0:1784045307.903344:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045307.903346:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903518:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d1b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903578:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d1a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdfc expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903594:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d1ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdfc expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045307.903602:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:0.0:1784045307.903605:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045307.903608:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33200, rc 0) 00000100:00100000:0.0:1784045307.903737:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10391:x1870706808754176:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 3086us (3356us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1784045307.903755:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1784045307.908716:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045307.908804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045307.909049:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808754432 00000100:00100000:1.0:1784045307.909062:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808754432 00000100:00100000:1.0:1784045307.909137:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784045307.909161:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:2362:x1870706808754432:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045307.909180:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045307.909221:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d1ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdfc expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045307.909243:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045307.909249:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045307.909372:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2362:x1870706808754432:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 225us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.909381:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1784045307.910102:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808754304 00000100:00100000:2.0:1784045307.910107:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808754304 00000100:00100000:2.0:1784045307.910184:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1784045307.910253:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10391:x1870706808754304:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784045307.910332:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910351:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910363:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910411:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910420:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910427:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910464:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045307.910470:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910478:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910489:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045307.910492:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045307.910497:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045307.910504:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045307.910571:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10391:x1870706808754304:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 380us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045307.910579:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:0.0:1784045307.913789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045307.914176:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808754688 00000100:00100000:3.0:1784045307.914197:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808754688 00000100:00100000:3.0:1784045307.914302:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1784045307.914314:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10391:x1870706808754688:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045307.914627:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10391:x1870706808754688:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 314us (849us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1784045307.914637:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00010000:00010000:2.0:1784045308.129183:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045308.141530:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045308.141610:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808754944 00000100:00100000:2.0:1784045308.141622:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808754944 00000100:00100000:2.0:1784045308.141701:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:2.0:1784045308.141713:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10409:x1870706808754944:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:2.0:1784045308.141767:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045308.141794:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe03 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.142246:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d1d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.142283:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.142298:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d1d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045308.142314:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784045308.142683:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe03 expref: 18 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.142708:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d1d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe03 expref: 17 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.142718:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045308.142721:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784045308.142726:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045308.143625:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10409:x1870706808754944:12345-192.168.201.58@tcp:101:cat.0 Request processed in 1907us (2104us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1784045308.143636:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1784045308.183604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045308.183784:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808755072 00000100:00100000:1.0:1784045308.183797:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808755072 00000100:00100000:1.0:1784045308.183906:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:1.0:1784045308.183918:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10410:x1870706808755072:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045308.183951:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045308.183976:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d1e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe0a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.184062:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d1eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.184080:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d1eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.184114:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d1eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045308.184532:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1784045308.184538:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045308.184928:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d1eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.184967:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d1e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe0a expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.184987:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d1eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe0a expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.184997:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045308.185000:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045308.185003:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361600, rc 0) 00000100:00100000:1.0:1784045308.185154:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10410:x1870706808755072:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1238us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045308.185163:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:0.0:1784045308.197673:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045308.197846:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808755456 00000100:00100000:3.0:1784045308.197878:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808755456 00000100:00100000:3.0:1784045308.197957:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1784045308.197968:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10410:x1870706808755456:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045308.198458:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10410:x1870706808755456:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 490us (799us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1784045308.198467:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784045308.203451:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045308.203552:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808755584 00000100:00100000:1.0:1784045308.203565:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808755584 00000100:00100000:1.0:1784045308.203656:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784045308.203669:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10410:x1870706808755584:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:1.0:1784045308.203700:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784045308.203733:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d174 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdee expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.203795:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d1d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe03 expref: 18 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.203812:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d07f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffdaf expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045308.203824:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045308.203914:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045308.203987:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10410:x1870706808755584:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 320us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045308.203995:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1784045308.219000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045308.219325:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808755712 00000100:00100000:3.0:1784045308.219340:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808755712 00000100:00100000:3.0:1784045308.219428:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:3.0:1784045308.219441:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10410:x1870706808755712:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:3.0:1784045308.219619:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045308.219640:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045308.219655:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045308.226620:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045308.229359:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1784045308.229490:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1784045308.229673:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10410:x1870706808755712:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 10225us (10679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045308.231492:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:0.0:1784045308.261197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045308.261453:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808755840 00000100:00100000:2.0:1784045308.261463:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808755840 00000100:00100000:2.0:1784045308.261600:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:2.0:1784045308.261626:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10412:x1870706808755840:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045308.261645:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045308.261667:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe11 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.261748:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.261762:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.261779:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.261795:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.261802:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.261809:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262131:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262138:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262155:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045308.262196:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784045308.262199:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045308.262216:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262227:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262236:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262242:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262248:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262267:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045308.262271:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262278:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262295:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:2.0:1784045308.262297:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045308.262302:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262308:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262333:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262338:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262343:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262347:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045308.262350:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262355:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262362:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa902ec0000) 00010000:00010000:2.0:1784045308.262364:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045308.262367:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262373:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262402:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d1f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262415:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045308.262434:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:2.0:1784045308.262437:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045308.262439:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045308.262496:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10412:x1870706808755840:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 873us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045308.262504:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000040:00080000:1.0:1784045309.025106:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045309.025115:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045309.025182:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784045309.025189:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045309.025328:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829752832:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045309.025429:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045309.032725:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829752832:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045309.033382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.033499:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808755968 00000100:00100000:2.0:1784045309.033507:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808755968 00000100:00100000:2.0:1784045309.034123:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1784045309.034145:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808755968:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784045309.034254:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808755968:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 Request processed in 99us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.034263:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00080000:0.0:1784045309.035331:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045309.058630:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.058871:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808756096 00000100:00100000:2.0:1784045309.058880:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808756096 00000100:00100000:2.0:1784045309.059043:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:2.0:1784045309.059054:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808756096:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045309.059087:0:7507:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045309.059254:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808756096:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 201us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.059261:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:3.0:1784045309.076181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.077530:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808756224 00000100:00100000:2.0:1784045309.077544:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808756224 00000100:00100000:2.0:1784045309.077615:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1784045309.077626:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808756224:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.077714:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077733:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077748:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077764:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077772:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077780:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077806:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077814:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077819:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045309.077876:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784045309.077893:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045309.077908:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077920:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077934:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077941:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077948:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045309.077952:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077960:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077972:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:2.0:1784045309.077975:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045309.077979:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077985:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d215 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.077997:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078003:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078009:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078015:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045309.078025:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078031:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078040:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8aa902ec0d00) 00010000:00010000:2.0:1784045309.078043:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045309.078045:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078051:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d21c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078068:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078075:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078081:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078086:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045309.078089:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078095:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078103:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:2.0:1784045309.078105:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045309.078114:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.078119:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d223 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.078225:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808756224:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 600us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.078234:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:1.0:1784045309.081410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.081506:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808756480 00000100:00100000:2.0:1784045309.081518:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808756480 00000100:00100000:2.0:1784045309.081595:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1784045309.081607:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808756480:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.081629:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045309.081651:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d22a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe18 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081753:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081769:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081781:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045309.081792:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784045309.081910:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081919:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081934:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081940:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045309.081944:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081951:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081964:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:2.0:1784045309.081968:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045309.081972:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.081979:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.082019:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d22a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe18 expref: 19 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.082029:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:2.0:1784045309.082031:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045309.082034:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d22a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe18 expref: 19 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.082045:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720600, rc 0) 00000100:00100000:2.0:1784045309.082111:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10424:x1870706808756480:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 506us (708us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1784045309.082139:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:0.0:1784045309.092306:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.093684:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808756608 00000100:00100000:2.0:1784045309.093754:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808756608 00000100:00100000:2.0:1784045309.093852:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:2.0:1784045309.093864:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10424:x1870706808756608:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045309.093913:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045309.094043:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10424:x1870706808756608:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 181us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.094051:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784045309.099178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.099218:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808756864 00000100:00100000:1.0:1784045309.099227:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808756864 00000100:00100000:1.0:1784045309.099282:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1784045309.099292:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10424:x1870706808756864:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045309.099315:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045309.099325:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784045309.099353:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d1eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe0a expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.099372:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045309.099378:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045309.099391:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d23f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe1f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045309.117734:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1784045309.121747:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.121770:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.121783:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.121872:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d23f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe1f expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.121891:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe1f expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.122460:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045309.122464:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045309.122468:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360800, rc 0) 00000100:00100000:1.0:1784045309.122549:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10424:x1870706808756864:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 23257us (23386us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1784045309.122576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:3.0:1784045309.130816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.131665:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808757120 00000100:00100000:2.0:1784045309.131678:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808757120 00000100:00100000:2.0:1784045309.131758:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:2.0:1784045309.131770:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10424:x1870706808757120:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.131867:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045309.131905:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe1f expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.131923:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045309.131934:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045309.131958:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.131971:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.131981:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132059:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132068:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132076:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132389:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132398:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132404:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132411:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045309.132415:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132423:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132433:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:2.0:1784045309.132436:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045309.132439:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132445:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d254 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132462:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132468:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132474:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132479:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045309.132483:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132489:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132497:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9c61b80e (ffff8aa902ec0d00) 00010000:00010000:2.0:1784045309.132500:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045309.132503:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.132508:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d25b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9c61b80e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.132594:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10424:x1870706808757120:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 825us (1788us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045309.132603:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:2.0:1784045309.140348:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045309.140418:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808757248 00000100:00100000:0.0:1784045309.140428:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808757248 00000100:00100000:0.0:1784045309.140528:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:0.0:1784045309.140539:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10424:x1870706808757248:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045309.140561:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045309.140583:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d262 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe26 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.140620:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.140634:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.140645:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.140750:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 20 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.140766:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 19 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.140775:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:0.0:1784045309.140777:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784045309.140781:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32400, rc 0) 00000100:00100000:0.0:1784045309.140893:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10424:x1870706808757248:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 354us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045309.141091:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:1.0:1784045309.150238:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045309.150390:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808757504 00000100:00100000:0.0:1784045309.150402:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808757504 00000100:00100000:0.0:1784045309.150460:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1784045309.150471:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10424:x1870706808757504:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045309.150577:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.150594:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.150606:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045309.151003:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1784045309.151013:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343837181800ns, next at 344837179564ns, rc = 0 00000004:00010000:0.0:1784045309.151103:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052bbb413 reply state 0000000028ce6bb0 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045309.151114:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045309.151357:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10424:x1870706808757504:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 887us (1193us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1784045309.151365:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00010000:00010000:0.0:1784045309.153980:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045309.171866:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.181329:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808757632 00000100:00100000:3.0:1784045309.181342:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808757632 00000100:00100000:3.0:1784045309.181427:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:3.0:1784045309.181437:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10424:x1870706808757632:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045309.181462:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045309.181483:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe2d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.181572:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.181586:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.181604:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:3.0:1784045309.181607:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045309.181611:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f400, rc 0) 00000100:00100000:3.0:1784045309.181675:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10424:x1870706808757632:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 240us (9819us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.181682:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00010000:00010000:1.0:1784045309.182628:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.182640:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.182647:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.182653:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045309.182658:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.182665:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.182678:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:1.0:1784045309.182681:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784045309.182685:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.182691:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d270 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045309.195044:0:11866:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045309.195053:0:11866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045309.195088:0:11866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784045309.195100:0:11866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045309.200877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.202662:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808757760 00000100:00100000:1.0:1784045309.202675:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808757760 00000100:00100000:1.0:1784045309.202732:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:1.0:1784045309.202741:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808757760:12345-192.168.201.58@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1784045309.202782:0:6599:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:1.0:1784045309.202808:0:6599:0:(genops.c:1406:class_connect()) connect: client 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1, cookie 0xdb5b5ff6a2d2d27e 00002000:00100000:1.0:1784045309.202820:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1/ffff8aa9035cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784045309.202859:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784045309.203085:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784045309.203114:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa9035cf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045309.203206:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2359:x1870706808757760:12345-192.168.201.58@tcp:8:lhsmtool_posix.0 Request processed in 457us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045309.203214:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1784045309.210465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.211366:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808757888 00000100:00100000:1.0:1784045309.211376:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808757888 00000100:00100000:1.0:1784045309.211464:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:1.0:1784045309.211474:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:0:x1870706808757888:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1784045309.212427:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1784045309.318754:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1784045309.318766:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000100:00100000:1.0:1784045309.319145:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:0:x1870706808757888:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 107666us (108684us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784045309.319157:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:0.0:1784045309.326813:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.329542:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808758144 00000100:00100000:3.0:1784045309.329562:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808758144 00000100:00100000:3.0:1784045309.329654:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784045309.329666:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10424:x1870706808758144:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045309.330113:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10424:x1870706808758144:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 447us (3308us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1784045309.330132:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784045309.333943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.334098:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808758400 00000100:00100000:3.0:1784045309.334107:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808758400 00000100:00100000:3.0:1784045309.334174:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1784045309.334185:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10424:x1870706808758400:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045309.334285:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10424:x1870706808758400:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 102us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.334304:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1784045309.346662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.349357:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808758528 00000100:00100000:3.0:1784045309.349371:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808758528 00000100:00100000:2.0:1784045309.349569:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045309.349586:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa907f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829752960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045309.349652:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045309.349705:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829752960 00000100:00100000:2.0:1784045309.349709:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829752960 00000100:00100000:2.0:1784045309.349743:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784045309.349751:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829752960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045309.349772:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045309.349812:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829752960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.349820:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1784045309.350262:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045309.350309:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa907f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829752960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045309.350397:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:3.0:1784045309.350411:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10424:x1870706808758528:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045309.350426:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045309.350455:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe34 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.350522:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d28c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.350537:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.350551:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045309.350587:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045309.350604:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.350627:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe34 expref: 24 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.350643:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d28c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe34 expref: 23 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.350652:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:3.0:1784045309.350661:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784045309.350665:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ec00, rc 0) 00000100:00100000:3.0:1784045309.350708:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10424:x1870706808758528:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 301us (4055us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.350714:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1784045309.367239:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.367740:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808758656 00000100:00100000:2.0:1784045309.367750:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808758656 00000100:00100000:2.0:1784045309.367808:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:2.0:1784045309.367819:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808758656:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.368733:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045309.368760:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe3b expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045309.368790:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565efd, blocks: 0x1 00010000:00010000:2.0:1784045309.368810:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1784045309.368820:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045309.368983:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.369519:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.369535:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045309.369605:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808758656:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1788us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.369613:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:2.0:1784045309.380759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.380857:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808758912 00000100:00100000:3.0:1784045309.380866:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808758912 00000100:00100000:3.0:1784045309.380930:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:3.0:1784045309.380939:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10424:x1870706808758912:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045309.381317:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10424:x1870706808758912:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 378us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.381326:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:2.0:1784045309.384678:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.385335:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759040 00000100:00100000:1.0:1784045309.385345:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759040 00000100:00100000:2.0:1784045309.385451:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:2.0:1784045309.385463:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:10424:x1870706808759040:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.385481:0:8930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045309.385500:0:8930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe42 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.385532:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.385542:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045309.385546:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045309.385551:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.385597:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.385611:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.385624:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829753088:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045309.385824:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa930353cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045309.404468:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829753088:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045309.404504:0:8930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.404525:0:8930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:3.0:1784045309.404584:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:10424:x1870706808759040:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 19124us (19926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.404594:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:3.0:1784045309.414187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045309.414276:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759168 00000100:00100000:0.0:1784045309.414286:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759168 00010000:00010000:0.0:1784045309.414325:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045309.414363:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784045309.414372:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808759168:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045309.414387:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045309.414410:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.414423:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.414456:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d293 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe3b expref: 7 pid: 6598 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.414472:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045309.414476:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045309.414485:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.414495:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.414539:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045309.414553:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93b5a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5790:1870706829753216:192.168.201.58@tcp:105: 00000100:00100000:0.0:1784045309.414620:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045309.421822:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93b5a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5790:1870706829753216:192.168.201.58@tcp:105: 00010000:00010000:0.0:1784045309.421870:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045309.421928:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808759168:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 7557us (7756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045309.421939:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1784045309.426727:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.426795:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759296 00000100:00100000:1.0:1784045309.426805:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759296 00002000:00100000:1.0:1784045309.426882:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8aa9082a1880 x1870706808759296/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:705/0 lens 504/0 e 0 to 0 dl 1784045320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784045309.426902:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa9082a1880 with x1870706808759296 ext(0->8) 00002000:00010000:1.0:1784045309.426909:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa9082a1880 00000100:00100000:1.0:1784045309.426937:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784045309.426955:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808759296:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784045309.428540:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808759296:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 1581us (1816us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784045309.428552:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00002000:00100000:1.0:1784045309.428562:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8aa9082a1880 x1870706808759296/t4294967302(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:705/0 lens 504/448 e 0 to 0 dl 1784045320 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784045309.428570:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa9082a1880 with x1870706808759296 ext(0->8) 00002000:00010000:1.0:1784045309.428575:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa9082a1880 00000100:00100000:3.0:1784045309.432930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045309.434546:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759424 00000100:00100000:0.0:1784045309.434559:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759424 00000100:00100000:0.0:1784045309.434613:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:0.0:1784045309.434622:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10424:x1870706808759424:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1784045309.518402:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10424:x1870706808759424:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 83769us (85479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045309.518416:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000001:00080000:0.0:1784045309.518460:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1784045309.518466:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1784045309.518504:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1784045309.518515:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1784045309.518634:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1784045309.518644:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1784045309.518657:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829753344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784045309.518735:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045309.518797:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829753344 00000100:00100000:0.0:1784045309.518804:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829753344 00000100:00100000:0.0:1784045309.518869:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045309.518877:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829753344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784045309.519011:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784045309.519014:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784045309 00002000:00010000:0.0:1784045309.519017:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784045309.519019:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784045309 -> 1784045309 00002000:00010000:0.0:1784045309.519022:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784045309.519052:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829753344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (317us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784045309.519058:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1784045309.519092:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa93b5a8380/2, rc 0, transno 4294967303 00000100:00100000:0.0:1784045309.519097:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829753344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784045309.522254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.522408:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759552 00000100:00100000:2.0:1784045309.522418:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759552 00000100:00100000:2.0:1784045309.522480:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:2.0:1784045309.522493:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808759552:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1784045309.574106:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1784045309.574134:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1784045309.574336:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808759552:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 51841us (52085us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045309.574348:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784045309.577281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.577402:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759808 00000100:00100000:2.0:1784045309.577412:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759808 00000100:00100000:2.0:1784045309.577464:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:2.0:1784045309.577472:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10424:x1870706808759808:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.577522:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045309.577547:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d28c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe34 expref: 13 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.577566:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:2.0:1784045309.577571:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045309.577612:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.577625:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.577636:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045309.577941:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002be86298 reply state 000000009e986166 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.577951:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045309.578458:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10424:x1870706808759808:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 984us (1182us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1784045309.578467:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:2.0:1784045309.581487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045309.581555:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808759936 00000100:00100000:0.0:1784045309.581564:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808759936 00000100:00100000:0.0:1784045309.581617:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:0.0:1784045309.581626:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808759936:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784045309.581888:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784045309.581892:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784045309 -> 1784045307 00002000:00010000:0.0:1784045309.581906:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784045306 00002000:00010000:0.0:1784045309.581909:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784045309 -> 1784045307 00002000:00010000:0.0:1784045309.581916:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784045309.581977:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808759936:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 350us (498us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784045309.581985:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00010000:00010000:3.0:1784045309.584276:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584292:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584311:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584317:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045309.584323:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584330:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584346:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:3.0:1784045309.584349:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045309.584353:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584359:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d2a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.584450:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.584526:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808760192 00000100:00100000:3.0:1784045309.584533:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808760192 00000100:00100000:3.0:1784045309.584613:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1784045309.584622:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10424:x1870706808760192:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784045309.584688:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584701:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 13 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584710:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584746:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 13 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.584758:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 13 pid: 7507 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045309.584772:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829753472:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045309.584883:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045309.586887:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829753472:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045309.586926:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.587990:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.588165:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808760320 00000100:00100000:2.0:1784045309.588173:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808760320 00010000:00010000:2.0:1784045309.588210:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 14 pid: 7507 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.588248:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784045309.588257:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2360:x1870706808760320:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045309.588270:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045309.588276:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 14 pid: 7507 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.588288:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 14 pid: 7507 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.588326:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2d269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe26 expref: 14 pid: 7507 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.588340:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:2.0:1784045309.588345:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.588354:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.588361:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.588383:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045309.588432:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:2360:x1870706808760320:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 176us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.588440:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00010000:00010000:3.0:1784045309.588686:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588695:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588724:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588731:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588737:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588743:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ea00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045309.588747:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588761:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588771:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:3.0:1784045309.588774:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784045309.588777:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.588783:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d2a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045309.588865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:10424:x1870706808760192:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 4243us (4416us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784045309.588872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1784045309.591604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.591976:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808760448 00000100:00100000:3.0:1784045309.591986:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808760448 00000100:00100000:2.0:1784045309.592127:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:2.0:1784045309.592139:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2363:x1870706808760448:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.592178:0:8930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.592198:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.592216:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045309.592220:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045309.592237:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.592268:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.592282:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 7 pid: 8930 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.592296:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829753600:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045309.592368:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045309.594328:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829753600:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045309.594354:0:8930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.595443:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.595510:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808760576 00000100:00100000:2.0:1784045309.595516:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808760576 00010000:00010000:2.0:1784045309.595552:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 8 pid: 8930 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.595588:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:2.0:1784045309.595597:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808760576:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045309.595611:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045309.595634:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 8 pid: 8930 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.595673:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 8 pid: 8930 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.595696:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076ca2d5a/0xdb5b5ff6a2d2d29a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe42 expref: 8 pid: 8930 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.595712:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045309.595717:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045309.595722:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.595732:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.595763:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045309.595807:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808760576:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 211us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045309.595814:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00010000:00010000:1.0:1784045309.596262:0:8930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596273:0:8930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596298:0:8930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596306:0:8930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596315:0:8930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596329:0:8930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045309.596333:0:8930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596342:0:8930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596356:0:8930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.596365:0:8930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2d2af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.596425:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808760448:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 4288us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045309.596432:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:0.0:1784045309.599153:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045309.599223:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808760832 00000100:00100000:2.0:1784045309.599232:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808760832 00000100:00100000:2.0:1784045309.599278:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:2.0:1784045309.599287:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:10424:x1870706808760832:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784045309.599358:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599375:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599399:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599582:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599593:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599601:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599631:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.599644:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 13 pid: 5805 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045309.599657:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829753728:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045309.599734:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045309.606048:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.606108:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808760960 00000100:00100000:1.0:1784045309.606125:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808760960 00010000:00010000:1.0:1784045309.606166:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 14 pid: 5805 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.606212:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1784045309.606221:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2361:x1870706808760960:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045309.606236:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045309.606243:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 14 pid: 5805 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.606269:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 14 pid: 5805 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.606292:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:1.0:1784045309.606297:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.606312:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.606320:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.606338:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045309.606392:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2361:x1870706808760960:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 170us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045309.606399:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00010000:00010000:0.0:1784045309.606645:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe2d expref: 13 pid: 5805 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045309.606661:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829753728:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045309.606680:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.606689:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045309.606695:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045309.606894:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1784045309.607036:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1784045309.607077:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1784045309.607157:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1870706829753856:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784045309.607448:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045309.607512:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045309.608556:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829753856 00000100:00100000:3.0:1784045309.608566:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829753856 00000100:00100000:3.0:1784045309.608615:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045309.608623:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1870706829753856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784045309.608761:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1870706829753856:12345-0@lo:1000:mdt00_002.0 Request processed in 138us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.608768:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045309.609401:0:5806:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1784045309.609408:0:5806:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa93b5a8380, transno 4294967303 00000100:00100000:2.0:1784045309.609453:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1870706829753856:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784045309.609923:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1784045309.609992:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1870706829753984:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045309.610030:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045309.610064:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9118116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045309.610242:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829753984 00000100:00100000:3.0:1784045309.610247:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829753984 00000100:00100000:3.0:1784045309.610285:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045309.610291:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1870706829753984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784045309.610467:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1870706829753984:12345-0@lo:1000:mdt00_002.0 Request processed in 175us (435us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784045309.610479:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045309.610564:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1870706829753984:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1784045309.610594:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610604:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610612:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610619:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045309.610624:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610637:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610653:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:1.0:1784045309.610656:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045309.610661:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610678:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d2bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610714:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610720:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610726:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610730:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045309.610733:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610739:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610747:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:1.0:1784045309.610749:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045309.610751:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610765:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d1f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610786:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610799:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610808:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610853:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.610866:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 16 pid: 5804 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.610878:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829754112:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045309.610948:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045309.614243:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045309.614273:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808761088 00000100:00100000:1.0:1784045309.614280:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808761088 00010000:00010000:1.0:1784045309.614319:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 17 pid: 5804 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045309.614353:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:1.0:1784045309.614362:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:2360:x1870706808761088:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045309.614391:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045309.614398:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 17 pid: 5804 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.614411:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 17 pid: 5804 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.614433:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:1.0:1784045309.614439:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.614448:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.614456:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045309.614474:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045309.614516:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:2360:x1870706808761088:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 155us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045309.614523:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00010000:00010000:3.0:1784045309.614759:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d20e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe11 expref: 16 pid: 5804 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045309.614776:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829754112:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045309.614798:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614808:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614814:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614859:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614867:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614874:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614880:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045309.614884:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614892:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614902:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:3.0:1784045309.614914:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045309.614919:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614925:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d2c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614936:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614942:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614948:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614953:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045309.614956:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614962:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614968:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa92210cb00) 00010000:00010000:3.0:1784045309.614970:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045309.614972:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.614979:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d2b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045309.615178:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10424:x1870706808760832:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 15891us (16031us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1784045309.615194:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000020:00080000:3.0:1784045309.615197:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1784045309.616314:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045309.616321:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045309.616348:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784045309.616354:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045309.620180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045309.620354:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808761344 00000100:00100000:3.0:1784045309.620365:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808761344 00000100:00100000:3.0:1784045309.620425:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784045309.620434:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10424:x1870706808761344:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784045309.621070:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784045309.621179:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1784045309.621230:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.621246:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.621259:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.621268:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.621275:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.621282:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045309.621304:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784045309.621391:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10424:x1870706808761344:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 957us (1218us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1784045309.621408:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000020:00080000:3.0:1784045309.621413:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784045309.621694:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045309.621700:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.621708:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045309.621712:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.621720:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.621732:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:2.0:1784045309.621735:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784045309.621739:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.621746:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d2cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045309.621762:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045309.621764:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045309.621766:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045310.177811:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045310.626025:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045310.626035:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045310.626072:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784045310.626091:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1784045311.006502:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1784045311.006520:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1784045311.210338:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045311.352739:0:11920:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045311.352749:0:11920:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045311.352796:0:11920:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784045311.352802:0:11920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045311.394980:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829754240:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395047:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045311.395086:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829754752:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395122:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045311.395144:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784045311.395149:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829754368:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395195:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045311.395216:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829754880:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395238:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045311.395262:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829754496:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395280:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045311.395299:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045311.395304:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829754624:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395321:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045311.395349:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829754240 00000100:00100000:1.0:1784045311.395356:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829754240 00000100:00100000:1.0:1784045311.395392:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784045311.395400:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829754240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395439:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906129050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829754240:12345-0@lo:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045311.395447:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784045311.395474:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829754752 00000100:00100000:1.0:1784045311.395477:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829754752 00000100:00100000:1.0:1784045311.395512:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829754368 00000100:00100000:1.0:1784045311.395514:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829754368 00000100:00100000:1.0:1784045311.395523:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829754496 00000100:00100000:1.0:1784045311.395525:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829754496 00000100:00100000:1.0:1784045311.395537:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784045311.395542:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829754752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395569:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829754752:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045311.395574:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784045311.395584:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784045311.395589:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829754368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395607:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829754368:12345-0@lo:400:kworker.0 Request processed in 19us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045311.395612:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784045311.395621:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784045311.395625:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829754496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395662:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829754496:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045311.395667:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784045311.395683:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829754880 00000100:00100000:1.0:1784045311.395685:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829754880 00000100:00100000:1.0:1784045311.395707:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829754624 00000100:00100000:1.0:1784045311.395709:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829754624 00000100:00100000:1.0:1784045311.395722:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784045311.395727:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829754880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395750:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829754880:12345-0@lo:400:kworker.0 Request processed in 23us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045311.395764:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784045311.395774:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784045311.395779:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829754624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395800:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829754624:12345-0@lo:400:kworker.0 Request processed in 21us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045311.395805:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1784045311.395826:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045311.395848:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045311.395851:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045311.395882:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829754624:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395890:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90360d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829754496:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395913:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829754368:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395919:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1784045311.395924:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1784045311.395936:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa93b5aaa00, transno 4294967301 00000100:00100000:1.0:1784045311.395944:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829754880:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395952:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829754240:0@lo:400:kworker.0 00000100:00100000:1.0:1784045311.395960:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829754752:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.399251:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045311.399275:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829755008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045311.399348:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.399400:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829755008 00000100:00100000:0.0:1784045311.399406:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829755008 00000100:00100000:0.0:1784045311.399453:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784045311.399461:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829755008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045311.399497:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045311.399541:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829755008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.399549:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784045311.399599:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829755008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045311.558051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045311.559065:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808761600 00000100:00100000:1.0:1784045311.559076:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808761600 00000100:00100000:1.0:1784045311.559292:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:1.0:1784045311.559307:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:10441:x1870706808761600:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045311.559334:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045311.559368:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d2d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe49 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.559625:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d2d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.559654:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.559667:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045311.559678:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1784045311.559856:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d2d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe49 expref: 20 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.559875:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe49 expref: 19 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.560033:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045311.560037:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784045311.560041:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360a00, rc 0) 00000100:00100000:1.0:1784045311.560109:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10441:x1870706808761600:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 806us (2067us total) trans 4294967363 rc 0/0 00000100:00080000:3.0:1784045311.563622:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045311.567393:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:0.0:1784045311.568299:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045311.568426:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808761728 00000100:00100000:2.0:1784045311.568435:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808761728 00000100:00100000:2.0:1784045311.568488:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:2.0:1784045311.568496:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10441:x1870706808761728:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:2.0:1784045311.568567:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.568595:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.568607:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.568622:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.568629:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.568646:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569042:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569051:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569059:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045311.569108:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569120:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569127:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569144:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569150:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045311.569154:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569162:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569174:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:2.0:1784045311.569177:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045311.569181:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569188:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d2e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569198:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569407:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569413:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569417:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045311.569420:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569438:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569447:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa902ec0800) 00010000:00010000:2.0:1784045311.569450:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045311.569453:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569458:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d2ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569473:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569480:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569485:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569490:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045311.569493:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569498:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569506:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa902ec0c00) 00010000:00010000:2.0:1784045311.569508:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045311.569510:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.569526:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d2f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045311.569609:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10441:x1870706808761728:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1111us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.569618:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1784045311.648626:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.652196:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808761984 00000100:00100000:0.0:1784045311.652722:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808761984 00000100:00100000:0.0:1784045311.654328:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:0.0:1784045311.654346:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10445:x1870706808761984:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045311.654369:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045311.654392:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d2fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe50 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.654468:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.654483:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.654505:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.654522:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.654529:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.654536:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655190:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655346:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655358:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045311.655372:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784045311.655473:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655480:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655487:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655493:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045311.655504:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655512:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655523:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045311.655527:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045311.655532:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655537:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d303 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655549:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655554:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655560:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655564:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045311.655567:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655572:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655579:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5d00) 00010000:00010000:0.0:1784045311.655581:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045311.655590:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655595:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d30a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655651:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d2fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655666:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.655673:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045311.655675:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045311.655677:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:0.0:1784045311.655798:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10445:x1870706808761984:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1458us (7183us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784045311.655808:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:3.0:1784045311.663700:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045311.663742:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808762112 00000100:00100000:3.0:1784045311.663752:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808762112 00000100:00100000:3.0:1784045311.663803:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1784045311.663814:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10445:x1870706808762112:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784045311.663913:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.663930:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.663942:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.663968:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.663976:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.663982:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.663988:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045311.663992:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.664014:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.664028:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:3.0:1784045311.664031:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045311.664035:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.664041:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d31f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045311.664113:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10445:x1870706808762112:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 301us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045311.664121:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1784045311.665847:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045311.665889:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808762368 00000100:00100000:3.0:1784045311.665897:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808762368 00000100:00100000:3.0:1784045311.665939:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784045311.665948:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10445:x1870706808762368:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045311.666172:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10445:x1870706808762368:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 224us (342us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1784045311.666180:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784045311.722648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.723116:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808762624 00000100:00100000:0.0:1784045311.723127:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808762624 00000100:00100000:0.0:1784045311.723256:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784045311.723267:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:9965:x1870706808762624:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045311.723293:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045311.723316:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d326 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe57 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.723422:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.723454:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.723463:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.723494:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.723507:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 23 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045311.723521:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941fe0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829755136:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045311.724029:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8d240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045311.727255:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941fe0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829755136:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045311.727288:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045311.727508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.727796:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808762752 00000100:00100000:0.0:1784045311.727804:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808762752 00010000:00010000:0.0:1784045311.727880:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 24 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045311.727910:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:0.0:1784045311.727920:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:2360:x1870706808762752:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045311.727935:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045311.727955:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 24 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.727968:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 24 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.727992:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe50 expref: 24 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.728007:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045311.728012:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.728022:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.728028:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.728126:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045311.728180:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:2360:x1870706808762752:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 261us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.728187:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00010000:00010000:2.0:1784045311.731821:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.731973:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045311.732001:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784045311.736380:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d326 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.736433:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.736443:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:3.0:1784045311.736447:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045311.736450:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33200, rc 0) 00000100:00100000:3.0:1784045311.736574:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:9965:x1870706808762624:12345-192.168.201.58@tcp:101:bash.0 Request processed in 13307us (13945us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784045311.736583:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:3.0:1784045311.747253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045311.747403:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763008 00000100:00100000:2.0:1784045311.747414:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763008 00000100:00100000:2.0:1784045311.747475:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:2.0:1784045311.747485:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:9965:x1870706808763008:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:2.0:1784045311.747764:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.747781:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.747794:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045311.748003:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1784045311.748030:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d8aebb5 reply state 00000000e5a69100 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045311.748056:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784045311.748118:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1784045311.748323:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:9965:x1870706808763008:12345-192.168.201.58@tcp:36:bash.0 Request processed in 838us (1083us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1784045311.748332:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 89 00000020:00080000:2.0:1784045311.748337:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784045311.759222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.759548:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763136 00000100:00100000:0.0:1784045311.759558:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763136 00000100:00100000:0.0:1784045311.759628:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:0.0:1784045311.759639:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:9965:x1870706808763136:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045311.759665:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045311.759687:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe5e expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.759764:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe5e expref: 28 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.759780:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d342 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe5e expref: 28 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.759800:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045311.759803:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045311.759806:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32a00, rc 0) 00000100:00100000:0.0:1784045311.759901:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:9965:x1870706808763136:12345-192.168.201.58@tcp:101:bash.0 Request processed in 264us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.759908:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:3.0:1784045311.763288:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.763744:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763264 00000100:00100000:0.0:1784045311.763755:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763264 00000100:00100000:0.0:1784045311.763861:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1784045311.763871:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:9965:x1870706808763264:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045311.763899:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045311.763920:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe65 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045311.763944:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a565efb, atime: 0x6a565efa, ctime: 0x6a565efb, blocks: 0xb 00010000:00010000:0.0:1784045311.763965:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1784045311.763970:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045311.763978:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.764014:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.764025:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33600, rc 0) 00000100:00100000:0.0:1784045311.764078:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:9965:x1870706808763264:12345-192.168.201.58@tcp:101:bash.0 Request processed in 209us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.764096:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00080000:3.0:1784045311.764286:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045311.765721:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.765735:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.765757:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.765764:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045311.765769:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.765776:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.765792:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:1.0:1784045311.765795:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045311.765799:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045311.765806:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d33b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045311.773166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.773400:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763392 00000100:00100000:0.0:1784045311.773410:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763392 00002000:00010000:0.0:1784045311.773453:0:6603:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1784045311.773459:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa941a1c700 with x1870706808763392 ext(0->18446744073709551615) 00002000:00010000:0.0:1784045311.773471:0:6603:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa941a1c700. 00000100:00100000:0.0:1784045311.773549:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784045311.773559:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2363:x1870706808763392:12345-192.168.201.58@tcp:10:bash.0 00002000:00010000:0.0:1784045311.773907:0:6603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784045311.773911:0:6603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784045307 -> 1784045311 00002000:00010000:0.0:1784045311.773915:0:6603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1784045306 -> 1784045306 00002000:00010000:0.0:1784045311.773917:0:6603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784045307 -> 1784045311 00002000:00010000:0.0:1784045311.773919:0:6603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1784045311.773975:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2363:x1870706808763392:12345-192.168.201.58@tcp:10:bash.0 Request processed in 416us (820us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784045311.773984:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00010000:0.0:1784045311.773987:0:6603:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1784045311.773991:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa941a1c700 with x1870706808763392 ext(0->18446744073709551615) 00002000:00010000:0.0:1784045311.774009:0:6603:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa941a1c700. 00000100:00100000:2.0:1784045311.877369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045311.877469:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763520 00000100:00100000:3.0:1784045311.877478:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763520 00000100:00100000:3.0:1784045311.877539:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:3.0:1784045311.877551:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:10459:x1870706808763520:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784045311.877625:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.877654:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.877667:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.877685:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.877709:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.877717:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878101:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878112:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878119:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045311.878163:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878175:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878182:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878189:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878197:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ea00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045311.878201:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878209:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878230:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045311.878233:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045311.878238:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878245:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878260:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878266:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878271:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878276:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045311.878279:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878284:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878292:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa92210c100) 00010000:00010000:3.0:1784045311.878294:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045311.878297:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878302:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878327:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878333:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878339:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878344:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045311.878347:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878353:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878361:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:3.0:1784045311.878363:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045311.878366:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.878372:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d35e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045311.878460:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:10459:x1870706808763520:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 909us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045311.878470:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:1.0:1784045311.949437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.949634:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763776 00000100:00100000:0.0:1784045311.949646:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763776 00000100:00100000:0.0:1784045311.949714:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:0.0:1784045311.949725:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:10462:x1870706808763776:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045311.949750:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045311.949771:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d365 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe6c expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950037:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950053:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950064:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950091:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950099:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950105:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950640:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d37a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950650:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950665:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045311.950676:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784045311.950771:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950779:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950785:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950791:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045311.950795:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950802:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.950815:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045311.950818:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045311.950823:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952334:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952362:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952368:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952390:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952396:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045311.952400:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952407:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952421:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5e00) 00010000:00010000:0.0:1784045311.952424:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045311.952428:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952434:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d373 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952494:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d365 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe6c expref: 30 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952510:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe6c expref: 29 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045311.952517:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045311.952519:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784045311.952521:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32c00, rc 0) 00000100:00100000:0.0:1784045311.952646:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:10462:x1870706808763776:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2923us (3218us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1784045311.952664:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:2.0:1784045311.972422:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045311.972517:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808763904 00000100:00100000:3.0:1784045311.972527:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808763904 00000100:00100000:3.0:1784045311.972643:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:3.0:1784045311.972672:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:10462:x1870706808763904:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784045311.972745:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.972763:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.972773:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.972811:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.972827:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 29 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045311.972871:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829755264:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045311.972968:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345da780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045311.981479:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045311.983189:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808764160 00000100:00100000:0.0:1784045311.983204:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808764160 00000100:00100000:0.0:1784045311.983281:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:0.0:1784045311.983293:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:6038:x1870706808764160:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784045311.983636:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:6038:x1870706808764160:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 345us (2166us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784045311.983645:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:3.0:1784045311.987973:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829755264:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045311.988006:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045311.995620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045311.995724:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808764288 00000100:00100000:2.0:1784045311.995734:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808764288 00010000:00010000:2.0:1784045311.995776:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 31 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045311.995818:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:2.0:1784045311.995865:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:2361:x1870706808764288:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045311.995883:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045311.995890:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 31 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.995904:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 31 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.995927:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d32d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe57 expref: 31 pid: 5804 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.995964:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:2.0:1784045311.995970:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.995980:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.995988:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045311.996019:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045311.996067:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:2361:x1870706808764288:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 241us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.996075:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00010000:00010000:3.0:1784045311.996363:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996372:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996404:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996417:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996423:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996430:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148e000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045311.996433:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996440:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996449:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:3.0:1784045311.996452:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045311.996455:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045311.996461:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045311.996515:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:10462:x1870706808763904:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 23846us (24102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045311.996523:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:1.0:1784045312.000655:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.000759:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808764544 00000100:00100000:0.0:1784045312.000770:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808764544 00000100:00100000:0.0:1784045312.000864:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1784045312.000876:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:10462:x1870706808764544:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045312.001112:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:10462:x1870706808764544:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 238us (467us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1784045312.001121:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:2.0:1784045312.121391:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.121546:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808764800 00000100:00100000:3.0:1784045312.121560:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808764800 00000100:00100000:3.0:1784045312.121642:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1784045312.121654:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:10473:x1870706808764800:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:3.0:1784045312.121683:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.121724:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d38f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe73 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.121805:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.121820:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.121857:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.121884:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.121892:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.121899:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.122703:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.122716:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.122725:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.122736:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1784045312.122819:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.122861:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.122922:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.122979:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.123141:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123151:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123164:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045312.123167:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.123171:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123268:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123284:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123291:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123297:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123302:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ea00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.123313:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123320:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123328:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa92210c100) 00010000:00010000:3.0:1784045312.123331:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.123333:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123339:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d39d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123390:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d38f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe73 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123406:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe73 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.123414:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:3.0:1784045312.123416:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045312.123419:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f400, rc 0) 00000100:00100000:3.0:1784045312.123485:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:10473:x1870706808764800:12345-192.168.201.58@tcp:101:cat.0 Request processed in 1833us (2103us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1784045312.123494:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:2.0:1784045312.131750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.131863:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808765056 00000100:00100000:0.0:1784045312.131874:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808765056 00000100:00100000:0.0:1784045312.131946:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:0.0:1784045312.131957:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:10473:x1870706808765056:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1784045312.132213:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10473:x1870706808765056:12345-192.168.201.58@tcp:35:cat.0 Request processed in 257us (472us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1784045312.132221:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1784045312.161924:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.162608:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808765312 00000100:00100000:0.0:1784045312.162618:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808765312 00000100:00100000:0.0:1784045312.162781:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:0.0:1784045312.162805:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10474:x1870706808765312:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:0.0:1784045312.162894:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784045312.162923:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe73 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.162957:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d37a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe6c expref: 32 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.162970:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe5e expref: 31 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.162982:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045312.162992:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045312.163013:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163026:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163036:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163050:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163057:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163063:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163588:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163599:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.163607:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045312.164517:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1784045312.164526:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346850695725ns, next at 347850693792ns, rc = 0 00010000:00010000:0.0:1784045312.164585:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164597:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164606:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164614:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164621:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164627:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164779:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045312.164799:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164812:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164819:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164825:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045312.164854:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164863:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164884:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:0.0:1784045312.164887:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784045312.164890:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164897:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164914:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164920:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164925:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164938:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045312.164947:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164953:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164962:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045312.164965:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045312.164968:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.164973:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045312.164983:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e967fefc reply state 0000000001a4a8ef transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.164992:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045312.165087:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:10474:x1870706808765312:12345-192.168.201.58@tcp:36:rm.0 Request processed in 2272us (3161us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1784045312.165097:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00010000:00010000:3.0:1784045312.171281:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.171302:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.171325:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.171331:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.171337:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.171345:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.171361:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5e00) 00010000:00010000:3.0:1784045312.171365:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.171369:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.171376:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d3b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.172414:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045312.172425:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.172432:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045312.172436:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.172444:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.172455:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8aa9118c5f00) 00010000:00010000:2.0:1784045312.172458:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784045312.172474:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.172480:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d3c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.172499:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045312.172501:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045312.172502:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045312.209317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.209449:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808765568 00000100:00100000:0.0:1784045312.209460:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808765568 00000100:00100000:0.0:1784045312.209531:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:0.0:1784045312.209541:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:10480:x1870706808765568:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045312.209565:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045312.209588:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe7a expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.209738:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.209770:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.209782:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.209799:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.209807:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.209813:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045312.210577:0:7507:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1784045312.211093:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211108:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211118:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211149:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211156:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211164:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211178:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045312.211183:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211191:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211203:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:0.0:1784045312.211206:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045312.211210:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211217:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d3d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045312.211230:0:7507:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acdffd48 reply state 00000000def6c377 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.211239:0:7507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784045312.211268:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d3ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 34 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211281:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 33 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.211289:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:0.0:1784045312.211291:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045312.211293:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32c00, rc 0) 00000100:00100000:0.0:1784045312.211408:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:10480:x1870706808765568:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1868us (2099us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1784045312.211421:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:3.0:1784045312.215994:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:1.0:1784045312.216144:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.216158:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.216170:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.216191:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045312.216196:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.216213:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.216231:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa9118c5c00) 00010000:00010000:1.0:1784045312.216234:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045312.216240:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.216248:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d3dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.216673:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808765696 00000100:00100000:2.0:1784045312.216684:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808765696 00000100:00100000:2.0:1784045312.216797:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:2.0:1784045312.216809:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808765696:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045312.216827:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045312.216868:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe81 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045312.216965:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784045312.216987:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1784045312.216992:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045312.217001:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.217021:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 6 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.217033:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720800, rc 0) 00000100:00080000:1.0:1784045312.217193:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045312.217317:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808765696:12345-192.168.201.58@tcp:101:bash.0 Request processed in 509us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.217335:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784045312.220363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.220454:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808765824 00000100:00100000:0.0:1784045312.220464:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808765824 00000100:00100000:0.0:1784045312.220518:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784045312.220528:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:10480:x1870706808765824:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045312.220546:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045312.220562:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe88 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.220591:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.220602:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045312.220606:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045312.220611:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.220654:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 7 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.220668:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 7 pid: 6600 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.220684:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941fe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1870706829755392:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045312.220758:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8dcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1784045312.226266:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045312.226948:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.227483:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808765952 00000100:00100000:2.0:1784045312.227493:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808765952 00010000:00010000:2.0:1784045312.227540:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 8 pid: 6600 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.227583:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784045312.227593:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808765952:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045312.227646:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045312.227675:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 8 pid: 6600 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.227689:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 8 pid: 6600 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.227718:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045312.227723:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045312.227731:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.227741:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.227781:0:7497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.227808:0:7497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7497:1870706829755520:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784045312.227936:0:7497:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b480 going to sleep for 11 seconds 00010000:00010000:1.0:1784045312.228981:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d3f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe81 expref: 8 pid: 6600 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.229003:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941fe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1870706829755392:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045312.229028:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 7 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.229041:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:1.0:1784045312.229140:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:10480:x1870706808765824:12345-192.168.201.58@tcp:101:bash.0 Request processed in 8612us (8787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.229149:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:2.0:1784045312.232398:0:7497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7497:1870706829755520:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784045312.232423:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045312.232491:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808765952:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 4899us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.232502:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1784045312.234595:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.234712:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808766208 00000100:00100000:3.0:1784045312.234721:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808766208 00000100:00100000:3.0:1784045312.234769:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1784045312.234778:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:10480:x1870706808766208:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1784045312.235183:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:10480:x1870706808766208:12345-192.168.201.58@tcp:35:bash.0 Request processed in 404us (595us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1784045312.235191:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1784045312.372081:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.372367:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808766336 00000100:00100000:3.0:1784045312.372390:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808766336 00000100:00100000:3.0:1784045312.372489:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:3.0:1784045312.372499:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:10496:x1870706808766336:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045312.372522:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.372543:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d3ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe8f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.372608:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.372621:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.372634:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.372696:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784045312.372700:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045312.372721:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.372746:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d3ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe8f expref: 36 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.372766:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe8f expref: 35 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.372774:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045312.372777:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045312.372781:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ea00, rc 0) 00000100:00100000:3.0:1784045312.372917:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:10496:x1870706808766336:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 419us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045312.372925:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:0.0:1784045312.375918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.376039:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808766592 00000100:00100000:3.0:1784045312.376046:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808766592 00000100:00100000:3.0:1784045312.376143:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:3.0:1784045312.376153:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:10496:x1870706808766592:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045312.376182:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.376207:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d40d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.376302:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.376315:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.376326:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.376337:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784045312.376457:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d40d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe96 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.376475:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe96 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.376482:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045312.376485:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045312.376501:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f400, rc 0) 00000100:00100000:3.0:1784045312.376563:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:10496:x1870706808766592:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 412us (652us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1784045312.376570:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:1.0:1784045312.380124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.380341:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.380456:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808766848 00000100:00100000:3.0:1784045312.380464:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808766848 00000100:00100000:3.0:1784045312.380517:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:3.0:1784045312.380526:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:10496:x1870706808766848:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045312.380547:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.380565:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffe9d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.380655:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d429 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.380669:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.380681:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.380693:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784045312.380795:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe9d expref: 40 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.380813:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe9d expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.380822:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045312.381046:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045312.381050:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045312.381117:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:10496:x1870706808766848:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 591us (775us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1784045312.381124:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:0.0:1784045312.381649:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808766976 00000100:00100000:0.0:1784045312.381655:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808766976 00000100:00100000:0.0:1784045312.381730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784045312.381739:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:2362:x1870706808766976:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045312.381749:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045312.381766:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe96 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.381779:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:0.0:1784045312.381782:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045312.381817:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:2362:x1870706808766976:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 80us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045312.381823:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784045312.387565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.387684:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808767104 00000100:00100000:2.0:1784045312.387695:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808767104 00000100:00100000:2.0:1784045312.387789:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:2.0:1784045312.387799:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808767104:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:2.0:1784045312.387883:0:8930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.388009:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.388020:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784045312.388024:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045312.388029:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.388064:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 6 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.388106:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 6 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.388121:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8930:1870706829755648:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045312.388281:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045312.390354:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8930:1870706829755648:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045312.390382:0:8930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.391998:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.392069:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808767232 00000100:00100000:0.0:1784045312.392086:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808767232 00002000:00100000:0.0:1784045312.392139:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8aa939c5f480 x1870706808767232/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:708/0 lens 504/0 e 0 to 0 dl 1784045323 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045312.392148:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa939c5f480 with x1870706808767232 ext(0->8) 00010000:00010000:0.0:1784045312.392155:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 7 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.392166:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 7 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045312.392196:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa939c5f480 00000100:00100000:0.0:1784045312.392325:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784045312.392335:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808767232:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:0.0:1784045312.392754:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2361:x1870706808767232:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 420us (763us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784045312.392762:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00100000:0.0:1784045312.392769:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8aa939c5f480 x1870706808767232/t4294967302(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:708/0 lens 504/448 e 0 to 0 dl 1784045323 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045312.392778:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa939c5f480 with x1870706808767232 ext(0->8) 00010000:00010000:0.0:1784045312.392783:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 9 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.392794:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 9 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045312.392800:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa939c5f480 00000100:00100000:1.0:1784045312.395237:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.395305:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808767360 00000100:00100000:2.0:1784045312.395314:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808767360 00010000:00010000:2.0:1784045312.395352:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 9 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.395394:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:2.0:1784045312.395403:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808767360:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045312.395418:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784045312.395437:0:5789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784045312.395440:0:5789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784045312 00002000:00010000:2.0:1784045312.395442:0:5789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784045312 00002000:00010000:2.0:1784045312.395444:0:5789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784045312 00010000:00010000:2.0:1784045312.395450:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 9 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.395478:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 9 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.395497:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d3f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe88 expref: 9 pid: 6599 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.395510:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045312.395513:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045312.395518:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.395524:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.395549:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045312.395579:0:8930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.395588:0:8930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.395606:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808767360:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 203us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.395613:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00010000:00010000:1.0:1784045312.396608:0:8930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.396680:0:8930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.396689:0:8930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.396696:0:8930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045312.396701:0:8930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.396712:0:8930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.396749:0:8930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.396757:0:8930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086b97081/0xdb5b5ff6a2d2d437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.396845:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808767104:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 9030us (9271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.396853:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1784045312.398477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.398700:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808767616 00000100:00100000:0.0:1784045312.398709:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808767616 00000100:00100000:0.0:1784045312.398754:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:0.0:1784045312.398764:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:10496:x1870706808767616:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:0.0:1784045312.398825:0:5808:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe9d expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045312.399460:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1784045312.399498:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1784045312.399765:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1784045312.399818:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.400973:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 42 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.400983:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.401018:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 42 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.401028:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 42 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.401039:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941fe1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1870706829755776:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045312.401316:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045312.404303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.404771:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941fe1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1870706829755776:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045312.404800:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.405163:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808767744 00000100:00100000:1.0:1784045312.405180:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808767744 00010000:00010000:1.0:1784045312.405222:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 43 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.405259:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:1.0:1784045312.405267:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:2361:x1870706808767744:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045312.405282:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045312.405289:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 43 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.405301:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 43 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.405321:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d3e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe7a expref: 43 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.405354:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:1.0:1784045312.405359:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.405368:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.405376:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.405400:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045312.405451:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:2361:x1870706808767744:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 184us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.405458:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00010000:00010000:3.0:1784045312.405578:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.405586:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045312.405709:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1784045312.406091:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1784045312.406209:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829755904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784045312.406257:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045312.406289:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910138480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045312.407192:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829755904 00000100:00100000:1.0:1784045312.407210:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829755904 00000100:00100000:1.0:1784045312.407256:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045312.407263:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829755904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784045312.407338:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829755904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 75us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.407345:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045312.407561:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829755904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784045312.408336:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1784045312.408401:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829756032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784045312.408436:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045312.408459:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345dab40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045312.408657:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829756032 00000100:00100000:0.0:1784045312.408663:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829756032 00000100:00100000:0.0:1784045312.408692:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045312.408699:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829756032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784045312.408888:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1870706829756032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 189us (450us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784045312.408895:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045312.409685:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a16a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829756032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784045312.409758:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1784045312.409800:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.409810:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.409818:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.409824:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.409854:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.409869:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.409885:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045312.409888:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784045312.409893:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.410035:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d43e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045312.410339:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784045312.410422:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1784045312.410432:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347096601203ns, next at 348096598995ns, rc = 0 00000001:00080000:3.0:1784045312.410437:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1784045312.410468:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045312.410471:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045312.410484:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d429 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe9d expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.410581:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+45:10496:x1870706808767616:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 11817us (12111us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1784045312.410590:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000020:00080000:3.0:1784045312.410594:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784045312.413392:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.413467:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808767872 00000100:00100000:1.0:1784045312.413476:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808767872 00000100:00100000:1.0:1784045312.413527:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:1.0:1784045312.413536:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+45:10496:x1870706808767872:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045312.413557:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045312.413577:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffea4 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.413656:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffea4 expref: 46 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.413671:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d445 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffea4 expref: 46 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.413689:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045312.413691:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045312.413695:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360200, rc 0) 00000100:00100000:1.0:1784045312.413763:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+46:10496:x1870706808767872:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 227us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.413769:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:1.0:1784045312.417140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.417378:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808768128 00000100:00100000:3.0:1784045312.417387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808768128 00000100:00100000:3.0:1784045312.417444:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1784045312.417453:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+46:10496:x1870706808768128:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045312.417824:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:10496:x1870706808768128:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 371us (691us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1784045312.417860:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:0.0:1784045312.477122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.477357:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808768256 00000100:00100000:3.0:1784045312.477367:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808768256 00000100:00100000:3.0:1784045312.477475:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1784045312.477485:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:10506:x1870706808768256:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784045312.477566:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477584:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477596:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477609:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477626:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477634:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477734:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477742:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477749:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045312.477793:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477806:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477813:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477820:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477827:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.477868:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477877:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477905:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045312.477909:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.477914:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477920:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d44c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477934:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477940:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477946:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477951:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.477954:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477960:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477966:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa92210c100) 00010000:00010000:3.0:1784045312.477968:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.477971:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.477977:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478000:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478007:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478013:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478018:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.478021:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478026:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478033:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.478035:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.478038:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.478043:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d45a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.478130:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:10506:x1870706808768256:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 646us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045312.478137:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:0.0:1784045312.501786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.502046:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808768512 00000100:00100000:1.0:1784045312.502055:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808768512 00000100:00100000:1.0:1784045312.502125:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:1.0:1784045312.502135:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:10509:x1870706808768512:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045312.502155:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045312.502188:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffeab expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502286:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502302:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502334:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502351:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502360:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502366:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502501:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502510:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502517:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045312.502526:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1784045312.502630:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502637:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502644:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502650:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045312.502661:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502669:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502681:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045312.502684:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045312.502688:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502695:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502708:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502714:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502719:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502723:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045312.502726:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502731:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502737:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa91040d100) 00010000:00010000:1.0:1784045312.502739:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045312.502748:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502754:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d46f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502794:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 50 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502809:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 49 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.502816:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045312.502818:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045312.502821:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361200, rc 0) 00000100:00100000:1.0:1784045312.507014:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+49:10509:x1870706808768512:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 4867us (5223us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1784045312.507027:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:1.0:1784045312.510104:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.510543:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808768640 00000100:00100000:2.0:1784045312.510553:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808768640 00000100:00100000:2.0:1784045312.510651:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1784045312.510662:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+49:10509:x1870706808768640:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784045312.510732:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510749:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510775:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510801:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510808:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510815:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510821:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045312.510825:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510869:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510881:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:2.0:1784045312.510884:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045312.510889:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.510906:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d484 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.510974:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+49:10509:x1870706808768640:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 314us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.510982:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:0.0:1784045312.514254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.514390:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808768896 00000100:00100000:3.0:1784045312.514399:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808768896 00000100:00100000:3.0:1784045312.514455:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:3.0:1784045312.514477:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+49:10509:x1870706808768896:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045312.514705:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:10509:x1870706808768896:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 228us (458us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1784045312.514712:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784045312.608497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.608579:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808769152 00000100:00100000:3.0:1784045312.608589:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808769152 00000100:00100000:3.0:1784045312.608654:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:3.0:1784045312.608665:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:10519:x1870706808769152:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045312.608689:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.608692:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045312.608720:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe8f expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.608741:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045312.608746:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045312.608759:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d48b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffeb2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.608912:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.608927:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 50 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.608935:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.608970:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 50 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.608997:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 50 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.609011:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829756160:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045312.609115:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93a1a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1784045312.615747:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829756160:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045312.615779:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.618307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.618417:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808769280 00000100:00100000:1.0:1784045312.618427:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808769280 00010000:00010000:1.0:1784045312.618474:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 51 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.618520:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:1.0:1784045312.618529:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+51:2361:x1870706808769280:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045312.618545:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045312.618551:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 51 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.618579:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 51 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.618602:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeab expref: 51 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.618620:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045312.618625:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.618635:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.618643:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.618677:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045312.618742:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:2361:x1870706808769280:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 213us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.618750:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00010000:00010000:3.0:1784045312.619126:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.619134:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.619156:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784045312.619310:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d48b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.619328:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.619336:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.619338:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045312.619340:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148e000, rc 0) 00000100:00100000:3.0:1784045312.619373:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:10519:x1870706808769152:12345-192.168.201.58@tcp:101:bash.0 Request processed in 10710us (10886us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1784045312.619392:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:0.0:1784045312.625370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.625453:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808769536 00000100:00100000:3.0:1784045312.625463:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808769536 00000100:00100000:3.0:1784045312.625531:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1784045312.625541:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:10519:x1870706808769536:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:3.0:1784045312.625873:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.625892:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.626211:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045312.626269:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1784045312.626298:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bc290b1 reply state 00000000deb8f2cb transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.626307:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045312.626400:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+53:10519:x1870706808769536:12345-192.168.201.58@tcp:36:bash.0 Request processed in 860us (1040us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1784045312.626408:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 105 00000020:00080000:3.0:1784045312.626412:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045312.630961:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.630979:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.630986:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.631005:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ea00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.631010:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.631018:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.631034:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.631036:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.631040:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.631045:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.631258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.631508:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808769664 00000100:00100000:1.0:1784045312.631519:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808769664 00000100:00100000:1.0:1784045312.631572:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:1.0:1784045312.631581:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:10519:x1870706808769664:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784045312.631605:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045312.631623:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d4a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffeb9 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.631718:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.631732:0:7507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.631740:0:7507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.631773:0:7507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.631787:0:7507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 53 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.631801:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829756288:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045312.632054:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa922359840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045312.635431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.635768:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939c5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829756288:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045312.635799:0:7507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.636227:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808769792 00000100:00100000:3.0:1784045312.636236:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808769792 00010000:00010000:3.0:1784045312.636276:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 54 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.636360:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:3.0:1784045312.636371:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:2361:x1870706808769792:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045312.636386:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045312.636393:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 54 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.636405:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 54 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.636448:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d492 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb2 expref: 54 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.636463:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.636468:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.636477:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.636485:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.636515:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045312.636568:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+53:2361:x1870706808769792:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 199us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045312.636575:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00010000:00010000:0.0:1784045312.636631:0:7507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.636639:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045312.636684:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784045312.636688:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045312.636707:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.636737:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d4a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 53 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.636752:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 52 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045312.636759:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045312.636762:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045312.636765:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361e00, rc 0) 00000100:00100000:0.0:1784045312.636789:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:10519:x1870706808769664:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5210us (5535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045312.636796:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:0.0:1784045312.640649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.640718:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808770048 00000100:00100000:3.0:1784045312.640727:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808770048 00000100:00100000:3.0:1784045312.640785:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:3.0:1784045312.640795:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:10519:x1870706808770048:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:2.0:1784045312.641350:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+53:10519:x1870706808770048:12345-192.168.201.58@tcp:35:bash.0 Request processed in 555us (709us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1784045312.641369:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1784045312.756551:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.756783:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808770176 00000100:00100000:3.0:1784045312.756794:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808770176 00000100:00100000:3.0:1784045312.756884:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:3.0:1784045312.756960:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+53:10525:x1870706808770176:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045312.756986:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.757011:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d4b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffec0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.757106:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.757120:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.757132:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.757193:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784045312.757198:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045312.757236:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.757264:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec0 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.757283:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec0 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.757292:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045312.757295:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045312.757299:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148ea00, rc 0) 00000100:00100000:3.0:1784045312.757364:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:10525:x1870706808770176:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 471us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045312.757371:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:0.0:1784045312.765110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.768057:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808770304 00000100:00100000:3.0:1784045312.768082:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808770304 00000100:00100000:3.0:1784045312.768166:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 108 00000100:00100000:3.0:1784045312.768177:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:10525:x1870706808770304:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045312.768337:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.768362:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d4c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffec7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768447:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768462:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768473:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768489:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768496:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768502:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768601:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768610:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768618:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.768663:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1784045312.768668:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045312.768686:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768698:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768706:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768714:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768722:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768728:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148f400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.768732:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768740:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768752:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045312.768755:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.768760:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768766:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768789:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768795:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768801:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768807:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa90148ec00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045312.768810:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768817:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.768824:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa92210c100) 00010000:00010000:3.0:1784045312.770017:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045312.770027:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.770036:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ec00/0xdb5b5ff6a2d2d4d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.770094:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148e000/0xdb5b5ff6a2d2d4c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.770109:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.770132:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.770134:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045312.770137:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173600, rc 0) 00000100:00100000:3.0:1784045312.770529:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10525:x1870706808770304:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2028us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045312.770539:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 108 00000100:00100000:0.0:1784045312.775121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.775202:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808770560 00000100:00100000:3.0:1784045312.775213:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808770560 00000100:00100000:3.0:1784045312.775273:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:3.0:1784045312.775284:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10525:x1870706808770560:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045312.775308:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045312.775330:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d4df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffece expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775437:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775452:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775461:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775470:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775505:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775530:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 56 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.775544:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829756416:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045312.775700:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.775709:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.775718:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a16300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829756544:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045312.775741:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045312.781217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.781464:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808770688 00000100:00100000:1.0:1784045312.781473:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808770688 00010000:00010000:1.0:1784045312.781518:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 57 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045312.781567:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:1.0:1784045312.781588:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:2363:x1870706808770688:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045312.781605:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045312.781613:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 57 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.781627:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 57 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.781650:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045312.781655:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.781665:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045312.781672:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045312.781726:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:2363:x1870706808770688:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 141us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.781734:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00010000:00010000:3.0:1784045312.789019:0:5805:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.58@tcp) returned -22 from blocking AST (req@0000000069cce997 x1870706829756416) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 56 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.789045:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d4d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec7 expref: 56 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045312.789074:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829756416:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045312.789091:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a16300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829756544:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045312.789116:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.789122:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.789146:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.789156:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045312.789270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.789535:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808770816 00000100:00100000:2.0:1784045312.789542:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808770816 00010000:00010000:2.0:1784045312.789580:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045312.789677:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1784045312.789688:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa907eea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:2360:x1870706808770816:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045312.789706:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045312.789713:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.789726:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.789745:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d4ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeb9 expref: 56 pid: 7507 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.789757:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:2.0:1784045312.789761:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.789770:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.789778:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.789818:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045312.789924:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa907eea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:2360:x1870706808770816:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 237us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.789931:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00010000:00010000:3.0:1784045312.790110:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.790118:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045312.790138:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784045312.791519:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d4df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.791544:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045312.791553:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045312.791556:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045312.791559:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa90148f400, rc 0) 00000100:00100000:3.0:1784045312.791616:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10525:x1870706808770560:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 16335us (16505us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1784045312.791625:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:0.0:1784045312.795385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045312.800023:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771072 00000100:00100000:1.0:1784045312.800038:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771072 00000100:00100000:2.0:1784045312.800797:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045312.800811:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10525:x1870706808771072:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:2.0:1784045312.800847:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045312.800875:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffea4 expref: 55 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.802194:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:2.0:1784045312.802203:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045312.802278:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:10525:x1870706808771072:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 1468us (6901us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.802287:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784045312.804278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.804429:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771200 00000100:00100000:2.0:1784045312.804438:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771200 00000100:00100000:2.0:1784045312.804486:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:2.0:1784045312.804492:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:10525:x1870706808771200:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:2.0:1784045312.804578:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.804591:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.804600:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045312.804777:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784045312.804876:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:10525:x1870706808771200:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 382us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.804884:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:0.0:1784045312.807373:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045312.807447:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771328 00000100:00100000:2.0:1784045312.807456:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771328 00000100:00100000:2.0:1784045312.807504:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:2.0:1784045312.807513:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:10525:x1870706808771328:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045312.807532:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045312.807553:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffed5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.807716:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.807728:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.807749:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.807762:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.807775:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:2.0:1784045312.807778:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045312.807782:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045312.807801:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720200, rc 0) 00000100:00100000:2.0:1784045312.808142:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10525:x1870706808771328:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 628us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.808150:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:0.0:1784045312.931228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.931285:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045312.931320:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045312.931403:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771456 00000100:00100000:3.0:1784045312.931413:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771456 00000100:00100000:1.0:1784045312.931455:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771712 00000100:00100000:1.0:1784045312.931459:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771712 00000100:00100000:3.0:1784045312.931471:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 290 00000100:00100000:3.0:1784045312.931480:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808771456:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:1.0:1784045312.931483:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045312.931511:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:1.0:1784045312.931517:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808771712:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045312.931555:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808771712:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.931572:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:2.0:1784045312.931640:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771584 00000100:00100000:2.0:1784045312.931645:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771584 00000100:00100000:2.0:1784045312.931678:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:2.0:1784045312.931684:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2362:x1870706808771584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045312.932056:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808771456:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 576us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045312.932074:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 290 00000100:00100000:2.0:1784045312.932214:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2362:x1870706808771584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 529us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.932221:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00010000:00010000:2.0:1784045313.254036:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045313.698202:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045313.698212:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045313.698253:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1784045313.698259:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045313.698964:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939c5fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829756672:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045313.699070:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa922359780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045313.724502:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045313.724816:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939c5fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829756672:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045313.725627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771840 00000100:00100000:1.0:1784045313.725636:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771840 00000100:00100000:1.0:1784045313.725720:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:1.0:1784045313.725730:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10527:x1870706808771840:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784045313.725760:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784045313.725888:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10527:x1870706808771840:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 149us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045313.725896:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00080000:2.0:1784045313.726014:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045313.741090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.741205:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808771968 00000100:00100000:1.0:1784045313.741215:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808771968 00000100:00100000:1.0:1784045313.741277:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:1.0:1784045313.741288:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10527:x1870706808771968:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784045313.741570:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741589:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741602:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741671:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741679:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741686:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741713:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741722:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741728:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045313.741773:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784045313.741777:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045313.741791:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741802:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741809:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741817:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741946:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045313.741951:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741959:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741973:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:1.0:1784045313.741976:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045313.741981:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.741988:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d502 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742002:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742008:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742015:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742020:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045313.742023:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742029:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742046:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8aa91040d100) 00010000:00010000:1.0:1784045313.742061:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045313.742064:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742071:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d509 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742085:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742092:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742098:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742103:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045313.742105:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742111:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742118:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045313.742121:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045313.742124:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.742130:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045313.743099:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10527:x1870706808771968:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 1806us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045313.743109:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:0.0:1784045313.749064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.749311:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808772224 00000100:00100000:1.0:1784045313.749334:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808772224 00000100:00100000:1.0:1784045313.749806:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:1.0:1784045313.749819:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:10527:x1870706808772224:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045313.749864:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045313.751080:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d517 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffedc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751207:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751222:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751234:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045313.751246:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784045313.751431:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751440:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751447:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751471:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045313.751476:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751484:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751497:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045313.751501:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784045313.751505:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751511:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d51e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751556:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d517 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffedc expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751566:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:1.0:1784045313.751568:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045313.751572:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d517 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffedc expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.751582:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360200, rc 0) 00000100:00100000:1.0:1784045313.751643:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:10527:x1870706808772224:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1827us (2607us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1784045313.751653:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:0.0:1784045313.758668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.759221:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808772352 00000100:00100000:3.0:1784045313.759235:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808772352 00000100:00100000:3.0:1784045313.759316:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:3.0:1784045313.759329:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:10527:x1870706808772352:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045313.759386:0:7507:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045313.759531:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:10527:x1870706808772352:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 204us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045313.759539:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:0.0:1784045313.766433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.766681:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808772608 00000100:00100000:3.0:1784045313.766695:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808772608 00000100:00100000:3.0:1784045313.766788:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:3.0:1784045313.766801:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:10527:x1870706808772608:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045313.766867:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045313.766872:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045313.767706:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148ea00/0xdb5b5ff6a2d2d4bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffec0 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.767748:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045313.767755:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045313.768407:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d52c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffee3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045313.770134:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1784045313.772465:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045313.772498:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045313.772514:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045313.773991:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d52c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffee3 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045313.774029:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffee3 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045313.774042:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa902ec0500) 00010000:00010000:2.0:1784045313.774045:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045313.774059:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045313.774250:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:10527:x1870706808772608:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 7450us (7829us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1784045313.774262:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1784045313.797120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.797196:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808772864 00000100:00100000:3.0:1784045313.797208:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808772864 00000100:00100000:3.0:1784045313.797322:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:3.0:1784045313.797335:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:10527:x1870706808772864:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045313.797429:0:7507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045313.797465:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffee3 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797487:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa902ec0500) 00010000:00010000:3.0:1784045313.797500:0:7507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045313.797530:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797547:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797559:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797575:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797582:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797589:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797709:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797717:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797724:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797736:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045313.797741:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797750:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797759:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045313.797761:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045313.797765:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797771:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d541 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797783:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797788:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797794:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797800:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045313.797802:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797808:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797825:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9df03477 (ffff8aa92210c100) 00010000:00010000:3.0:1784045313.797827:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045313.797862:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.797870:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9df03477 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045313.797990:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:10527:x1870706808772864:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 658us (884us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045313.797998:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:0.0:1784045313.803106:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.803225:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808772992 00000100:00100000:1.0:1784045313.803239:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808772992 00000100:00100000:1.0:1784045313.803322:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:1.0:1784045313.803337:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:10527:x1870706808772992:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045313.803365:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045313.803396:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d54f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffeea expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.803443:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.803459:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.803473:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.803604:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d54f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.803638:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.804309:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:1.0:1784045313.804313:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784045313.804318:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361e00, rc 0) 00000100:00100000:1.0:1784045313.804407:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:10527:x1870706808772992:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1072us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045313.804415:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:2.0:1784045313.818676:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.818943:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808773248 00000100:00100000:1.0:1784045313.818956:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808773248 00000100:00100000:1.0:1784045313.819032:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:1.0:1784045313.819044:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:10527:x1870706808773248:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784045313.819178:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.819201:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.819230:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045313.819613:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1784045313.819626:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348505795136ns, next at 349505791969ns, rc = 0 00000004:00010000:1.0:1784045313.820168:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a487c9de reply state 00000000b32afaec transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045313.820182:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784045313.820393:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:10527:x1870706808773248:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1348us (1729us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1784045313.820404:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00010000:00010000:1.0:1784045313.822666:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.822688:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.822698:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.824167:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045313.824175:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.824186:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.824208:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:1.0:1784045313.824211:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784045313.824217:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.824224:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d55d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045313.825001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045313.825265:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808773376 00000100:00100000:0.0:1784045313.825278:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808773376 00000100:00100000:0.0:1784045313.825343:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1784045313.825354:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+58:10527:x1870706808773376:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045313.825387:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045313.825411:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffef1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.825484:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.825499:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.825536:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:0.0:1784045313.825539:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045313.825543:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33e00, rc 0) 00000100:00100000:0.0:1784045313.825618:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:10527:x1870706808773376:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 266us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045313.825626:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1784045313.836076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.836239:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808773504 00000100:00100000:1.0:1784045313.836253:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808773504 00000100:00100000:1.0:1784045313.836353:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1784045313.836372:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808773504:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784045313.837098:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2361:x1870706808773504:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 731us (1045us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784045313.837107:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00080000:2.0:1784045313.838480:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045313.845159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045313.845282:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808773760 00000100:00100000:0.0:1784045313.845295:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808773760 00000100:00100000:0.0:1784045313.845367:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784045313.845378:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:10527:x1870706808773760:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045313.845698:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:10527:x1870706808773760:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 321us (553us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1784045313.845707:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784045313.850353:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.850510:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774016 00000100:00100000:3.0:1784045313.850523:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774016 00000100:00100000:3.0:1784045313.850611:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:3.0:1784045313.850623:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:10527:x1870706808774016:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045313.851140:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:10527:x1870706808774016:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 516us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045313.851149:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:2.0:1784045313.854573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045313.854725:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774144 00000100:00100000:0.0:1784045313.854737:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774144 00000100:00100000:0.0:1784045313.854813:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:0.0:1784045313.854824:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:10527:x1870706808774144:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045313.854895:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045313.855104:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d56b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffef8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.855230:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.855314:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.855331:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045313.855380:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045313.855403:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.855434:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d56b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef8 expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.855455:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef8 expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045313.855464:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:0.0:1784045313.855467:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784045313.855470:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32e00, rc 0) 00000100:00100000:0.0:1784045313.855537:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:10527:x1870706808774144:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 715us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045313.855545:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:2.0:1784045313.859104:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.859189:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774272 00000100:00100000:3.0:1784045313.859201:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774272 00000100:00100000:3.0:1784045313.859325:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1784045313.859338:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808774272:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045313.859360:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045313.859388:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffeff expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045313.859441:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f01, blocks: 0x1 00010000:00010000:3.0:1784045313.859466:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1784045313.859471:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045313.859482:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 10 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.859505:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 10 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.859521:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044a00, rc 0) 00000100:00100000:3.0:1784045313.859641:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:2360:x1870706808774272:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 305us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045313.859649:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784045313.867663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.868013:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774528 00000100:00100000:1.0:1784045313.868026:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774528 00000100:00100000:1.0:1784045313.868106:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:1.0:1784045313.868118:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:10527:x1870706808774528:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784045313.868379:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:10527:x1870706808774528:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 262us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045313.868409:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:0.0:1784045313.871641:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.871727:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774656 00000100:00100000:3.0:1784045313.871741:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774656 00000100:00100000:3.0:1784045313.871821:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1784045313.871873:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:10527:x1870706808774656:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045313.871893:0:8930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045313.871920:0:8930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff06 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.871964:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 11 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.871997:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045313.872002:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045313.872008:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 11 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.872062:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 11 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.872077:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 11 pid: 6599 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045313.872094:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829756800:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045313.872198:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045313.876209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045313.876442:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774784 00000100:00100000:1.0:1784045313.876454:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774784 00010000:00010000:1.0:1784045313.876505:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 12 pid: 6599 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045313.876558:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1784045313.876568:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:2361:x1870706808774784:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045313.876590:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045313.876620:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 12 pid: 6599 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.876636:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 12 pid: 6599 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.876669:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045313.876674:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045313.876685:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 12 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.876697:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 12 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045313.876743:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 12 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045313.876793:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939c5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5790:1870706829756928:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784045313.876924:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9345da780 going to sleep for 11 seconds 00010000:00010000:3.0:1784045313.877982:0:8930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d579 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeff expref: 12 pid: 6599 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045313.878011:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829756800:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045313.878065:0:8930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 11 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045313.878080:0:8930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045e00, rc 0) 00000100:00100000:3.0:1784045313.878150:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:10527:x1870706808774656:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 6318us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045313.878176:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:0.0:1784045313.892791:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045313.892887:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808774912 00000100:00100000:2.0:1784045313.892901:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808774912 00002000:00100000:2.0:1784045313.892971:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8aa906013b80 x1870706808774912/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:709/0 lens 504/0 e 0 to 0 dl 1784045324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045313.892984:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa906013b80 with x1870706808774912 ext(0->12) 00002000:00010000:2.0:1784045313.892992:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa906013b80 00000100:00100000:2.0:1784045313.893032:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784045313.893054:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2360:x1870706808774912:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784045313.893280:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939c5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5790:1870706829756928:192.168.201.58@tcp:105: 00010000:00010000:1.0:1784045313.893310:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045313.893381:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2361:x1870706808774784:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 16811us (17188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045313.893393:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:2.0:1784045313.893687:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:2360:x1870706808774912:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 644us (911us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784045313.893696:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00002000:00100000:2.0:1784045313.893704:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8aa906013b80 x1870706808774912/t4294967308(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:709/0 lens 504/448 e 0 to 0 dl 1784045324 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045313.893714:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa906013b80 with x1870706808774912 ext(0->12) 00002000:00010000:2.0:1784045313.893719:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa906013b80 00000100:00100000:1.0:1784045313.905298:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045313.906263:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808775040 00000100:00100000:3.0:1784045313.906278:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808775040 00000100:00100000:3.0:1784045313.906363:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:3.0:1784045313.906377:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:10527:x1870706808775040:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784045314.008354:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1784045314.008393:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1784045314.008649:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1784045314.008697:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa92d10f900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1784045314.008703:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa93f681200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa92d10f000 00000020:00080000:1.0:1784045314.008707:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa93f681100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa92d1a2000 00000020:00080000:1.0:1784045314.008733:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000100:00100000:0.0:1784045314.009349:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829757056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784045314.009442:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045314.009571:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829757056 00000100:00100000:0.0:1784045314.009582:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829757056 00000100:00100000:0.0:1784045314.009668:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045314.009679:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829757056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784045314.009713:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1784045314.009746:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.009787:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.009808:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784045314.009814:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045314.009820:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.010011:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.010029:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 11 pid: 6599 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045314.010054:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829757312:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045314.010126:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8dd80 going to sleep for 11 seconds 00000020:00080000:1.0:1784045314.011235:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1784045314.011265:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829757184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784045314.011328:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784045314.011428:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1784045314.011447:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa910138300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1784045314.011452:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa9060e6800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa910138480 00000020:00080000:1.0:1784045314.011455:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa9060e6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa92d1b1000 00000100:00080000:2.0:1784045314.011732:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045314.011772:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829757440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784045314.016230:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784045314.016367:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1784045314.016485:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784045314.017890:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829757184 00000100:00100000:2.0:1784045314.017910:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829757184 00000100:00100000:2.0:1784045314.017979:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829757440 00000100:00100000:2.0:1784045314.017984:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829757440 00000100:00100000:2.0:1784045314.018020:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784045314.018031:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829757184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784045314.018318:0:8930:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784045314.018323:0:8930:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784045313 00002000:00010000:2.0:1784045314.018326:0:8930:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784045314.018329:0:8930:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784045313 -> 1784045313 00002000:00010000:2.0:1784045314.018331:0:8930:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784045314.018435:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3318:x1870706829757184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 406us (7106us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784045314.018444:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784045314.018465:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784045314.018472:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829757440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784045314.018492:0:8930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1784045314.018544:0:8930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a565f00, atime: 0x6a565f00, ctime: 0x6a565f00, blocks: 0x1 00010000:00010000:2.0:1784045314.018553:0:8930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.018574:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1784045314.018580:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045314.018588:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.018619:0:8930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.018630:0:8930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.018639:0:8930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.018658:0:8930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784045314.019215:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3319:x1870706829757440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 743us (7384us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784045314.019223:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1784045314.019265:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784045314.019277:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045314.019284:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.019294:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045314.019305:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.019316:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.019336:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.019345:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2d58e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.019366:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045314.019368:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045314.019370:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045314.020323:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10527:x1870706808775040:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 113941us (115033us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.020334:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000004:00080000:1.0:1784045314.020406:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa906013800/2, rc 0, transno 4294967309 00000100:00100000:1.0:1784045314.020414:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829757184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1784045314.020458:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa939c5c380/2, rc 0, transno 4294967304 00000100:00100000:1.0:1784045314.020463:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829757440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784045314.026544:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906011c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829757312:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045314.026585:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.030130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045314.030392:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808775168 00000100:00100000:1.0:1784045314.030405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808775168 00010000:00010000:1.0:1784045314.030460:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 12 pid: 6599 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045314.030514:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:1.0:1784045314.030525:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:2360:x1870706808775168:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045314.030549:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045314.030556:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 12 pid: 6599 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.030573:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 12 pid: 6599 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.030615:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2d349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe65 expref: 12 pid: 6599 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.030657:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045314.030662:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045314.030671:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.030682:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.030723:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045314.030816:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2360:x1870706808775168:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 291us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.030825:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00010000:00010000:0.0:1784045314.031304:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.031317:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.031329:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.031338:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.031367:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784045314.032342:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3321:x1870706829757056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22651us (22887us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784045314.032358:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1784045314.032659:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa906012d80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784045314.032668:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829757056:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1784045314.037034:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045314.037063:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.037081:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045314.037087:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.037107:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.037138:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.037176:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2d587 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.037212:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045314.037214:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045314.037216:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045314.041530:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045314.041586:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808775296 00000100:00100000:2.0:1784045314.041610:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808775296 00000100:00100000:2.0:1784045314.041677:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784045314.041687:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2362:x1870706808775296:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1784045314.100487:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1784045314.100511:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1784045314.100544:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1784045314.100556:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1784045314.100715:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808775296:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 59019us (59191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045314.100730:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784045314.113692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045314.113764:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808775552 00000100:00100000:3.0:1784045314.113779:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808775552 00000100:00100000:3.0:1784045314.113907:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1784045314.113918:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10527:x1870706808775552:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045314.113992:0:7507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045314.114029:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef8 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.114064:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:3.0:1784045314.114070:0:7507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045314.114116:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.114133:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.114146:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045314.114460:0:7507:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd93ce18 reply state 000000002b1b1ad7 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045314.114472:0:7507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045314.114616:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:10527:x1870706808775552:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 699us (940us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1784045314.114624:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00010000:00010000:3.0:1784045314.118070:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.118091:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.118100:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.118106:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045314.118112:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.118121:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.118142:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:3.0:1784045314.118145:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045314.118152:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.118158:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d595 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.122717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045314.123160:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808775680 00000100:00100000:0.0:1784045314.123171:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808775680 00000100:00100000:0.0:1784045314.123244:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784045314.123270:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808775680:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784045314.123638:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1784045314.123641:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1784045313 -> 1784045312 00002000:00010000:0.0:1784045314.123644:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784045312 00002000:00010000:0.0:1784045314.123645:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784045313 -> 1784045312 00002000:00010000:0.0:1784045314.123647:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784045314.123719:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808775680:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 450us (1016us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1784045314.123727:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784045314.126453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045314.127348:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808775936 00000100:00100000:2.0:1784045314.127382:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808775936 00000100:00100000:2.0:1784045314.127559:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:2.0:1784045314.127572:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:10527:x1870706808775936:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784045314.127678:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.127702:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.127714:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.127769:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.127784:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 15 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.127817:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829757568:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045314.128200:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045314.133753:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829757568:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045314.133805:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045314.134147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045314.134386:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808776064 00000100:00100000:3.0:1784045314.134395:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808776064 00010000:00010000:3.0:1784045314.134445:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 16 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045314.134515:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:3.0:1784045314.134526:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:2360:x1870706808776064:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045314.134548:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045314.134557:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 16 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.134571:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 16 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.134604:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d556 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffeea expref: 16 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.134619:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:3.0:1784045314.134624:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.134632:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.134638:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.134661:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045314.134738:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:2360:x1870706808776064:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 212us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045314.134747:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00010000:00010000:2.0:1784045314.135101:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135111:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135162:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135171:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135179:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135186:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045314.135192:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135201:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135212:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:2.0:1784045314.135215:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784045314.135220:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.135227:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d59c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.135286:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10527:x1870706808775936:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 7718us (8846us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784045314.135293:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:0.0:1784045314.140206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045314.140285:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808776192 00000100:00100000:2.0:1784045314.140297:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808776192 00000100:00100000:2.0:1784045314.140361:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1784045314.140394:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808776192:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784045314.140459:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.140489:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.140496:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045314.140500:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045314.140504:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.140545:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.140563:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 7 pid: 8930 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.140583:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6600:1870706829757696:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045314.140681:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045314.143780:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6600:1870706829757696:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045314.143822:0:6600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045314.144494:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045314.144702:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808776320 00000100:00100000:1.0:1784045314.144711:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808776320 00010000:00010000:1.0:1784045314.144761:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 8 pid: 8930 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045314.144809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:1.0:1784045314.144820:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808776320:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045314.144870:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045314.144904:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 8 pid: 8930 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.144921:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 8 pid: 8930 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.144950:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2d580 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff06 expref: 8 pid: 8930 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.144973:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045314.144978:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045314.145003:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.145015:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.145061:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045314.145130:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808776320:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 311us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.145138:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00010000:00010000:0.0:1784045314.145295:0:6600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145304:0:6600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145335:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145345:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145353:0:6600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145369:0:6600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045314.145374:0:6600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145384:0:6600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145397:0:6600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.145406:0:6600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d5a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045314.145462:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808776192:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 5071us (5267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045314.145483:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1784045314.150172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045314.150315:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808776576 00000100:00100000:3.0:1784045314.150346:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808776576 00000100:00100000:3.0:1784045314.150430:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:3.0:1784045314.150442:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10527:x1870706808776576:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784045314.150557:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.150582:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.150599:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.151723:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.151755:0:7507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.151766:0:7507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.152191:0:7507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.152212:0:7507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 15 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.152233:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829757824:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045314.152386:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045314.156529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045314.156684:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808776704 00000100:00100000:1.0:1784045314.156696:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808776704 00010000:00010000:1.0:1784045314.156756:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 16 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045314.156805:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1784045314.156816:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:2360:x1870706808776704:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045314.156880:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045314.156890:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 16 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.156906:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 16 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.156938:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:1.0:1784045314.156944:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.156974:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.156982:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.157008:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045314.157085:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:2360:x1870706808776704:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 269us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.157094:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00010000:00010000:2.0:1784045314.157550:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2d564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffef1 expref: 15 pid: 5806 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.157571:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829757824:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045314.157600:0:7507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.157610:0:7507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.157615:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045314.157912:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1784045314.158118:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1784045314.158168:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1784045314.158269:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7507:1870706829757952:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784045314.158355:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045314.158465:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045314.160231:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829757952 00000100:00100000:0.0:1784045314.160249:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829757952 00000100:00100000:1.0:1784045314.160456:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045314.160479:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7507:x1870706829757952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784045314.160687:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7507:x1870706829757952:12345-0@lo:1000:mdt00_003.0 Request processed in 220us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.160696:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045314.161007:0:7507:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1784045314.161016:0:7507:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1784045314.161078:0:7507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa906013800, transno 4294967309 00000004:00080000:0.0:1784045314.161091:0:7507:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa906012d80, transno 4294967310 00000100:00100000:0.0:1784045314.161102:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7507:1870706829757952:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1784045314.161754:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1784045314.162160:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906011c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7507:1870706829758080:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784045314.162238:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045314.162271:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9102af240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045314.167506:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829758080 00000100:00100000:1.0:1784045314.167525:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829758080 00000100:00100000:1.0:1784045314.167919:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045314.167936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7507:x1870706829758080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784045314.168265:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7507:x1870706829758080:12345-0@lo:1000:mdt00_003.0 Request processed in 334us (6026us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784045314.168275:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045314.168915:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906011c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7507:1870706829758080:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784045314.168981:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.168995:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169004:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169011:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045314.169016:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169026:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169059:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa91040d100) 00010000:00010000:0.0:1784045314.169064:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045314.169070:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169077:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d5b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169117:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169124:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169146:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169152:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045314.169156:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169162:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169171:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045314.169173:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045314.169182:0:7507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169196:0:7507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169220:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.169265:0:7507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045314.169284:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829758208:192.168.201.58@tcp:105: 00000100:00100000:0.0:1784045314.169392:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9124183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045314.179499:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045314.179645:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808776832 00000100:00100000:2.0:1784045314.179657:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808776832 00000100:00100000:2.0:1784045314.179736:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1784045314.179748:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10525:x1870706808776832:12345-192.168.201.58@tcp:49:lfs.0 00000100:00100000:2.0:1784045314.180053:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:10525:x1870706808776832:12345-192.168.201.58@tcp:49:lfs.0 Request processed in 306us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045314.180062:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:0.0:1784045314.180789:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829758208:192.168.201.58@tcp:105: 00010000:00010000:0.0:1784045314.180884:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.180898:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d4f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181069:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181089:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181111:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181124:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181131:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181139:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181146:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045314.181151:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181160:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181173:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045314.181188:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045314.181192:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181198:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d5b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181209:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181214:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181227:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181232:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045314.181235:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181240:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181247:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045314.181250:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784045314.181253:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.181259:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045314.181905:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10527:x1870706808776576:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 31456us (31739us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1784045314.181919:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000020:00080000:1.0:1784045314.181926:0:7507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784045314.182442:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045314.182449:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045314.183133:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784045314.183145:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045314.189017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045314.189235:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808777088 00000100:00100000:0.0:1784045314.189251:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808777088 00000100:00100000:0.0:1784045314.189340:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:0.0:1784045314.190166:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10525:x1870706808777088:12345-192.168.201.58@tcp:58:lfs.0 00000040:00080000:0.0:1784045314.190714:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1784045314.190793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045314.190857:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10525:x1870706808777088:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 1506us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045314.190863:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808777344 00000100:00100000:0.0:1784045314.190866:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:3.0:1784045314.190871:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808777344 00000100:00100000:3.0:1784045314.190906:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784045314.190914:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:10527:x1870706808777344:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784045314.191512:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784045314.191614:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1784045314.191660:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.191679:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.191692:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.191702:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.191719:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.191726:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.191754:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045314.192160:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045314.192169:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.192177:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045314.192182:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.192191:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.192207:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:0.0:1784045314.192210:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784045314.192216:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.192233:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.192257:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045314.192259:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045314.192261:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045314.204988:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:10527:x1870706808777344:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 14052us (14174us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1784045314.205012:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000020:00080000:3.0:1784045314.205023:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784045314.243198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045314.243641:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808777472 00000100:00100000:3.0:1784045314.243655:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808777472 00000100:00100000:3.0:1784045314.243737:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:3.0:1784045314.243750:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:10529:x1870706808777472:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045314.243791:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045314.243821:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d5c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff0d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.243953:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.243971:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.243985:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.244003:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.244030:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045314.244037:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.245819:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.246229:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.246240:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.246315:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045314.246335:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 21 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045314.246371:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829758336:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045314.246608:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045314.254932:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829758336:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045314.254975:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045314.256876:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045314.256979:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808777728 00000100:00100000:0.0:1784045314.256991:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808777728 00000100:00100000:0.0:1784045314.257076:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1784045314.257088:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:5576:x1870706808777728:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784045314.257422:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:5576:x1870706808777728:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 336us (604us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1784045314.257431:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:2.0:1784045314.261294:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045314.262080:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808777856 00000100:00100000:0.0:1784045314.262094:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808777856 00010000:00010000:0.0:1784045314.262152:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 23 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045314.262218:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1784045314.262230:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:2361:x1870706808777856:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045314.262252:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045314.262261:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 23 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.262277:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 23 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.262328:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f400/0xdb5b5ff6a2d2d4e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffece expref: 23 pid: 5805 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.262551:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045314.262559:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.262572:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.262582:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045314.262685:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045314.262816:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2361:x1870706808777856:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 586us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045314.262826:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00010000:00010000:1.0:1784045314.263138:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263149:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045314.263209:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784045314.263215:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045314.263241:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263256:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263267:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263274:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263281:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263287:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045314.263291:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263299:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263310:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:1.0:1784045314.263325:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045314.263330:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263336:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d5cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263366:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263372:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263377:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263382:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045314.263384:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263389:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263396:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8aa92210ce00) 00010000:00010000:1.0:1784045314.263398:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045314.263402:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263407:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d5d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263455:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d5c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff0d expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263492:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff0d expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045314.263500:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:1.0:1784045314.263503:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045314.263505:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720c00, rc 0) 00000100:00100000:1.0:1784045314.263539:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10529:x1870706808777472:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 19792us (20357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.263548:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00010000:00010000:1.0:1784045314.273131:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045314.467398:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829758464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045314.467495:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045314.467729:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829758464 00000100:00100000:3.0:1784045314.467749:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829758464 00000100:00100000:3.0:1784045314.467817:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784045314.467846:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829758464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045314.467875:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784045314.467930:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829758464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045314.467938:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784045314.468153:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829758464:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1784045315.234686:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045315.234694:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045315.234771:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784045315.234778:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045315.234909:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a17480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829758592:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784045315.234986:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78000 going to sleep for 11 seconds 00000100:00100000:2.0:1784045315.244339:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045315.244387:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a17480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829758592:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784045315.244517:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808777984 00000100:00100000:2.0:1784045315.244523:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808777984 00000100:00100000:2.0:1784045315.244571:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:2.0:1784045315.244578:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10540:x1870706808777984:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045315.244605:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045315.244681:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10540:x1870706808777984:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 104us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045315.244686:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00080000:2.0:1784045315.244702:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045315.251225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045315.252112:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808778240 00000100:00100000:0.0:1784045315.252123:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808778240 00000100:00100000:0.0:1784045315.252187:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:0.0:1784045315.252197:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:10540:x1870706808778240:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045315.252218:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045315.252238:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d5e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff14 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.252370:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.252388:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.252410:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045315.252422:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784045315.252545:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d5e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff14 expref: 24 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.252562:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff14 expref: 23 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.252572:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045315.252574:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045315.252578:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32200, rc 0) 00000100:00100000:0.0:1784045315.252636:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10540:x1870706808778240:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 440us (1421us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784045315.252644:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:2.0:1784045315.262006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045315.262058:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045315.262135:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808778624 00000100:00100000:0.0:1784045315.262146:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808778624 00000100:00100000:0.0:1784045315.262216:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784045315.262225:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:2361:x1870706808778624:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045315.262241:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045315.262271:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff14 expref: 23 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.262294:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045315.262300:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045315.262504:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2361:x1870706808778624:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 279us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.262512:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784045315.262654:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808778496 00000100:00100000:3.0:1784045315.262667:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808778496 00000100:00100000:3.0:1784045315.262738:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:3.0:1784045315.262748:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:10540:x1870706808778496:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784045315.263119:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.263159:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.263176:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264325:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264339:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264347:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264354:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045315.264359:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264368:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264383:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045315.264387:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045315.264393:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.264400:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d5f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045315.265794:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10540:x1870706808778496:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 3034us (3782us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1784045315.265820:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 132 00000040:00080000:2.0:1784045315.266623:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045315.266632:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045315.267150:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784045315.267162:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045315.273691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045315.283205:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808778880 00000100:00100000:1.0:1784045315.283221:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808778880 00000100:00100000:1.0:1784045315.283291:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:1.0:1784045315.283302:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:10540:x1870706808778880:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784045315.283536:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:10540:x1870706808778880:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 234us (9853us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784045315.283543:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000040:00080000:0.0:1784045315.285964:0:11972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045315.285972:0:11972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045315.286036:0:11972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784045315.286043:0:11972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784045315.297040:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045315.556804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045315.561576:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779136 00000100:00100000:0.0:1784045315.561590:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779136 00000100:00100000:0.0:1784045315.561663:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:0.0:1784045315.561672:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:10553:x1870706808779136:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045315.561696:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045315.561717:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff1b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.561823:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d605 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.561883:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.561896:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045315.561924:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784045315.562047:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d5fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff1b expref: 27 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.562064:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff1b expref: 26 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.562072:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045315.562075:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784045315.562078:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32e00, rc 0) 00000100:00100000:0.0:1784045315.562141:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:10553:x1870706808779136:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 470us (5346us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1784045315.562148:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:1.0:1784045315.573507:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045315.573717:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779264 00000100:00100000:0.0:1784045315.573727:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779264 00000100:00100000:0.0:1784045315.573792:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:0.0:1784045315.573801:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:10553:x1870706808779264:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1784045315.573920:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.573938:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.573950:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.573976:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.573995:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.574003:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.574009:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045315.574013:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.574030:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.574043:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:0.0:1784045315.574046:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045315.574050:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.574056:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32200/0xdb5b5ff6a2d2d613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045315.574129:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:10553:x1870706808779264:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 328us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.574137:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:3.0:1784045315.677973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045315.679748:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779392 00000100:00100000:0.0:1784045315.679763:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779392 00000100:00080000:2.0:1784045315.679863:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045315.679898:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784045315.680198:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808779392:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784045315.680226:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045315.680352:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d61a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff22 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045315.680378:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a565f00, atime: 0x6a565f00, ctime: 0x6a565f00, blocks: 0xb 00010000:00010000:0.0:1784045315.680397:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1784045315.680401:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045315.680411:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d61a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff22 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.680428:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d61a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff22 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.680441:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32200, rc 0) 00000100:00100000:0.0:1784045315.680572:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2362:x1870706808779392:12345-192.168.201.58@tcp:101:cat.0 Request processed in 663us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.680580:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:1.0:1784045315.684760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045315.684867:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779520 00000100:00100000:0.0:1784045315.684877:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779520 00002000:00100000:0.0:1784045315.684928:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8aa906012680 x1870706808779520/t0(0) o3->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:711/0 lens 488/0 e 0 to 0 dl 1784045326 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045315.684940:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa906012680 with x1870706808779520 ext(0->4095) 00002000:00010000:0.0:1784045315.684946:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa906012680 00000100:00100000:0.0:1784045315.684981:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1784045315.684990:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2363:x1870706808779520:12345-192.168.201.58@tcp:3:cat.0 00000100:00100000:0.0:1784045315.685298:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2363:x1870706808779520:12345-192.168.201.58@tcp:3:cat.0 Request processed in 308us (546us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1784045315.685315:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00002000:00100000:0.0:1784045315.685322:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8aa906012680 x1870706808779520/t0(0) o3->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:711/0 lens 488/4536 e 0 to 0 dl 1784045326 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045315.685331:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa906012680 with x1870706808779520 ext(0->4095) 00002000:00010000:0.0:1784045315.685334:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa906012680 00000001:00080000:3.0:1784045316.052119:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1784045316.052136:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1784045316.052145:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:1.0:1784045316.322564:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045316.513104:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829758720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045316.513183:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045316.513595:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829758720 00000100:00100000:0.0:1784045316.513603:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829758720 00000100:00100000:0.0:1784045316.513673:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784045316.513683:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829758720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045316.513724:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045316.513778:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829758720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.513785:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1784045316.513888:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045316.514030:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1784045316.514190:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1784045316.514219:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa939c5c380, transno 4294967304 00000100:00100000:1.0:1784045316.514234:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829758720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045316.514382:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829758848:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.514423:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045316.514457:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829759360:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.514482:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045316.514503:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045316.514509:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829758976:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.514530:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045316.514556:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759360 00000100:00100000:0.0:1784045316.514560:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759360 00000100:00100000:0.0:1784045316.514593:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829758976 00000100:00100000:0.0:1784045316.514597:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829758976 00000100:00100000:0.0:1784045316.514615:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784045316.514621:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.514668:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829759360:12345-0@lo:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.514675:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784045316.514687:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784045316.514693:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829758976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.514719:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829758976:12345-0@lo:400:kworker.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.514725:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784045316.514755:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829758976:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.514767:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829759360:0@lo:400:kworker.0 00000100:00100000:3.0:1784045316.515261:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829758848 00000100:00100000:3.0:1784045316.515265:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829758848 00000100:00100000:3.0:1784045316.515357:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784045316.515373:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829758848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045316.515418:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829758848:12345-0@lo:400:kworker.0 Request processed in 55us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045316.515424:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784045316.515472:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829758848:0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.515744:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829759104:0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.515776:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045316.515816:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045316.515823:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829759232:0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.515870:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045316.515895:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759232 00000100:00100000:2.0:1784045316.515898:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759232 00000100:00100000:2.0:1784045316.515931:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045316.515939:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829759232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.515974:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829759232:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.515980:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045316.516021:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829759232:0@lo:400:kworker.0 00000100:00100000:3.0:1784045316.516143:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759104 00000100:00100000:3.0:1784045316.516147:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759104 00000100:00100000:3.0:1784045316.516230:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784045316.516236:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829759104:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784045316.516344:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045316.516349:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045316.520610:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829759104:12345-0@lo:400:kworker.0 Request processed in 4363us (4821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045316.520627:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784045316.523449:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829759104:0@lo:400:kworker.0 00010000:00010000:1.0:1784045317.347301:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045318.060555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045318.060602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045318.060646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045318.060779:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779648 00000100:00100000:1.0:1784045318.060790:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779648 00000100:00100000:1.0:1784045318.060885:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 292 00000100:00100000:1.0:1784045318.060895:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808779648:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045318.060934:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779776 00000100:00100000:0.0:1784045318.060941:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779776 00000100:00100000:0.0:1784045318.061022:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:0.0:1784045318.061030:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:2360:x1870706808779776:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045318.061068:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:2360:x1870706808779776:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045318.061076:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00080000:2.0:1784045318.061119:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045318.061159:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808779648:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 75us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045318.061168:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 292 00000100:00100000:2.0:1784045318.061746:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780032 00000100:00100000:2.0:1784045318.061752:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780032 00000100:00100000:2.0:1784045318.061806:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:2.0:1784045318.061814:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808780032:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045318.061890:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808780032:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 76us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045318.061897:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00080000:0.0:1784045318.061952:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045318.066272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045318.066326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045318.066412:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780160 00000100:00100000:3.0:1784045318.066423:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780160 00000100:00100000:3.0:1784045318.066526:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 143 00000100:00100000:3.0:1784045318.066538:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2361:x1870706808780160:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045318.066617:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2361:x1870706808780160:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045318.066624:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 143 00000100:00100000:2.0:1784045318.067109:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808779904 00000100:00100000:2.0:1784045318.067115:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808779904 00000100:00080000:0.0:1784045318.067128:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045318.067135:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045318.067157:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:2.0:1784045318.067167:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808779904:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045318.067227:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808779904:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 61us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045318.067235:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00010000:00010000:1.0:1784045318.369142:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784045319.158630:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1784045319.158652:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa9102af000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1784045319.158657:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa910141e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa9102af180 00000020:00080000:0.0:1784045319.158667:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa910141900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa9082f7000 00000020:00080000:0.0:1784045319.158701:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1784045319.158706:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:2.0:1784045319.160195:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1784045319.160424:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1784045319.205518:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1784045319.205537:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1784045319.408132:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045319.587756:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829759488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045319.587855:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045319.587930:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759488 00000100:00100000:0.0:1784045319.587937:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759488 00000100:00100000:0.0:1784045319.588004:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784045319.588013:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829759488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045319.588048:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045319.588094:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829759488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045319.588101:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1784045319.588120:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045319.588146:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1784045319.588152:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1784045319.588181:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829759488:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1784045320.417138:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045320.417153:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045320.417781:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1784045320.417791:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784045320.418508:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045321.441186:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045321.511801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045321.511967:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780288 00000100:00100000:3.0:1784045321.511981:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780288 00000100:00100000:3.0:1784045321.512084:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:3.0:1784045321.512100:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10206:x1870706808780288:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784045321.512269:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10206:x1870706808780288:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 Request processed in 174us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.512278:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00080000:0.0:1784045321.512404:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045321.515944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045321.516026:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780544 00000100:00100000:0.0:1784045321.516039:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780544 00000100:00100000:0.0:1784045321.516104:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784045321.516114:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:10206:x1870706808780544:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045321.516884:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:10206:x1870706808780544:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 767us (963us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1784045321.516898:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784045321.633616:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829760000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.633635:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829759744:0@lo:400:kworker.0 00000100:00100000:1.0:1784045321.633721:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.633732:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045321.633809:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829759616:0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.634011:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829759872:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.637246:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829760256:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.637311:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.637375:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759744 00000100:00100000:3.0:1784045321.637383:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759744 00000100:00100000:3.0:1784045321.637442:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784045321.637451:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829759744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.637659:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829759744:12345-0@lo:400:kworker.0 Request processed in 207us (3929us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.637667:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784045321.637721:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760000 00000100:00100000:3.0:1784045321.637726:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760000 00000100:00100000:3.0:1784045321.637770:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760256 00000100:00100000:3.0:1784045321.637774:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760256 00000100:00100000:3.0:1784045321.637796:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784045321.637802:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829760000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.637858:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829760000:12345-0@lo:400:kworker.0 Request processed in 55us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.637864:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784045321.637876:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784045321.637883:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829760256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.637923:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829760256:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.637931:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784045321.638004:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829759744:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.638018:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829760256:0@lo:400:kworker.0 00000100:00080000:3.0:1784045321.638083:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045321.638087:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045321.638144:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045321.638223:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829760128:0@lo:400:kworker.0 00000100:00100000:2.0:1784045321.638442:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045321.638618:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829760000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.639877:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759616 00000100:00100000:3.0:1784045321.639890:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759616 00000100:00100000:3.0:1784045321.639964:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1784045321.639976:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829759616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.640064:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90612a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829759616:12345-0@lo:400:kworker.0 Request processed in 91us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.640072:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1784045321.640133:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906013800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829759616:0@lo:400:kworker.0 00000100:00100000:2.0:1784045321.640690:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760128 00000100:00100000:2.0:1784045321.640700:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760128 00000100:00100000:2.0:1784045321.640871:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784045321.640883:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829760128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.640896:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045321.640957:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829760384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045321.640966:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829760128:12345-0@lo:400:kworker.0 Request processed in 85us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.640986:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784045321.641004:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829759872 00000100:00100000:0.0:1784045321.641007:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045321.641009:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829759872 00000100:00100000:0.0:1784045321.641038:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760384 00000100:00100000:0.0:1784045321.641043:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760384 00000100:00100000:0.0:1784045321.641081:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045321.641089:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829760384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045321.641106:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829760128:0@lo:400:kworker.0 00002000:00000024:0.0:1784045321.641125:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045321.641165:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829760384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.641172:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784045321.641482:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829760384:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1784045321.641577:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045321.641748:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784045321.641756:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829759872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045321.641808:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829759872:12345-0@lo:400:kworker.0 Request processed in 52us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.641816:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784045321.641863:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829759872:0@lo:400:kworker.0 00000100:00100000:2.0:1784045321.781810:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045321.782723:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780672 00000100:00100000:1.0:1784045321.782742:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780672 00000100:00080000:3.0:1784045321.782863:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045321.782938:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:1.0:1784045321.783213:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:11005:x1870706808780672:12345-192.168.201.58@tcp:101:lsof.0 00010000:00010000:1.0:1784045321.783244:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045321.783593:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff29 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045321.783698:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045321.783717:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045321.783732:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045321.784062:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784045321.784068:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045321.784247:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045321.784507:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045321.784529:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045321.784540:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045321.784544:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045321.784549:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361200, rc 0) 00000100:00100000:1.0:1784045321.784647:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:11005:x1870706808780672:12345-192.168.201.58@tcp:101:lsof.0 Request processed in 1699us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045321.784666:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00010000:00010000:1.0:1784045322.467633:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045323.168144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045323.168194:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045323.168230:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045323.168310:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780800 00000100:00100000:3.0:1784045323.168321:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780800 00000100:00100000:3.0:1784045323.168381:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 294 00000100:00100000:3.0:1784045323.168392:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808780800:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045323.168400:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808780928 00000100:00100000:2.0:1784045323.168403:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808780928 00000100:00100000:2.0:1784045323.168473:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:3.0:1784045323.168478:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808780800:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 88us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045323.168481:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2360:x1870706808780928:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045323.168485:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 294 00000100:00100000:2.0:1784045323.168518:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2360:x1870706808780928:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045323.168523:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00080000:2.0:1784045323.168557:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045323.168671:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781056 00000100:00100000:0.0:1784045323.168676:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781056 00000100:00100000:0.0:1784045323.168730:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:0.0:1784045323.168738:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808781056:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045323.168774:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808781056:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 37us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045323.168781:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00080000:2.0:1784045323.168789:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045323.179082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045323.179150:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045323.179388:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781184 00000100:00100000:3.0:1784045323.179399:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781184 00000100:00100000:3.0:1784045323.179491:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:3.0:1784045323.179503:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808781184:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045323.179582:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808781184:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 81us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045323.179591:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00080000:2.0:1784045323.179598:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045323.179907:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781312 00000100:00100000:0.0:1784045323.179913:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781312 00000100:00100000:0.0:1784045323.179968:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:0.0:1784045323.179975:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2360:x1870706808781312:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045323.180028:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2360:x1870706808781312:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 53us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045323.180035:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00080000:2.0:1784045323.180224:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784045323.489221:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784045324.291803:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1784045324.291865:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1784045324.291895:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1784045324.291910:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1784045324.513348:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045324.705104:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045324.705139:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829760512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045324.705210:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045324.705399:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760512 00000100:00100000:0.0:1784045324.705408:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760512 00000100:00100000:0.0:1784045324.705488:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784045324.705499:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829760512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045324.705537:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045324.705596:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829760512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045324.705603:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784045324.705657:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829760512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784045324.706004:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1784045325.160248:0:12172:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:08:43 (1784045323) 00010000:00010000:3.0:1784045325.537309:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045326.477207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045326.477379:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781568 00000100:00100000:2.0:1784045326.477389:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781568 00000100:00100000:2.0:1784045326.477476:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:2.0:1784045326.477490:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:11271:x1870706808781568:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045326.477514:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045326.477535:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d62f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff30 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.477615:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.477645:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.477680:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.477698:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784045326.478151:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784045326.478211:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.478222:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.485707:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d644 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.485731:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d644 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.485744:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d644 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045326.485759:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784045326.486027:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486035:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486042:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486048:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045326.486057:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486064:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486077:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045326.486080:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045326.486085:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486091:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d636 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486104:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486110:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486116:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486121:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045326.486123:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486128:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486135:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8aa902ec0b00) 00010000:00010000:2.0:1784045326.486136:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045326.486144:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.486149:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d63d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.488561:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d62f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff30 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.488586:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d644 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff30 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045326.488594:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:2.0:1784045326.488596:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045326.488600:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720600, rc 0) 00000100:00100000:2.0:1784045326.488685:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:11271:x1870706808781568:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 11199us (11486us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1784045326.488694:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:0.0:1784045326.492170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045326.492377:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781696 00000100:00100000:3.0:1784045326.492400:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781696 00000100:00100000:3.0:1784045326.492468:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:3.0:1784045326.492480:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:11271:x1870706808781696:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784045326.493083:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:11271:x1870706808781696:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 603us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045326.493093:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:0.0:1784045326.493704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045326.493895:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781824 00000100:00100000:1.0:1784045326.493902:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781824 00000100:00100000:1.0:1784045326.493952:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784045326.493960:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:2362:x1870706808781824:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045326.493973:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045326.493997:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d644 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff30 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045326.494021:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:1.0:1784045326.494026:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045326.494070:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2362:x1870706808781824:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.494076:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000040:00080000:3.0:1784045326.561075:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045326.561087:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045326.561562:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784045326.561570:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784045326.561703:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045326.753114:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829760640:0@lo:400:kworker.0 00000100:00100000:2.0:1784045326.753179:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045326.753226:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045326.753230:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829760768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045326.753252:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045326.753279:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760640 00000100:00100000:2.0:1784045326.753284:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760640 00000100:00100000:2.0:1784045326.753340:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784045326.753351:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829760640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045326.753413:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829760640:12345-0@lo:400:kworker.0 Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045326.753434:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784045326.753481:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760768 00000100:00100000:2.0:1784045326.753486:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760768 00000100:00100000:2.0:1784045326.753547:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784045326.753557:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829760768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045326.753589:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045326.753623:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829760768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045326.753627:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1784045326.753665:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045326.753725:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829760768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045326.753734:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829760640:0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.757637:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045326.757679:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829760896:0@lo:400:kworker.0 00000100:00100000:0.0:1784045326.757744:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045326.757769:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829761024:0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.757794:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045326.757891:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045326.758271:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829760896 00000100:00100000:0.0:1784045326.758277:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829761024 00000100:00100000:1.0:1784045326.758284:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829760896 00000100:00100000:0.0:1784045326.758287:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829761024 00000100:00100000:0.0:1784045326.758359:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784045326.759257:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045326.759283:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829761152:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.759350:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.759415:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829761280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.759440:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045326.759915:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829761152 00000100:00100000:2.0:1784045326.759925:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829761152 00000100:00100000:2.0:1784045326.759973:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784045326.759982:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829761152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045326.760058:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829761152:12345-0@lo:400:kworker.0 Request processed in 78us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045326.760066:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1784045326.760085:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045326.760090:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045326.760364:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829761152:0@lo:400:kworker.0 00000100:00100000:0.0:1784045326.766560:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829761024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.766646:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829761280 00000100:00100000:1.0:1784045326.766659:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829761280 00000100:00100000:1.0:1784045326.766706:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045326.766716:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829760896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045326.766817:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1784045326.766878:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1784045326.766895:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045326.776037:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829760896:12345-0@lo:400:kworker.0 Request processed in 9301us (18225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.776059:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045326.776119:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784045326.776136:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829761280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.776231:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829761280:12345-0@lo:400:kworker.0 Request processed in 103us (16789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.776238:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784045326.776431:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829761280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.776903:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829760896:0@lo:400:kworker.0 00000100:00100000:0.0:1784045326.781061:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829761024:12345-0@lo:400:kworker.0 Request processed in 22680us (23158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045326.781101:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784045326.782017:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829761024:0@lo:400:kworker.0 00010000:00010000:2.0:1784045327.593060:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045328.290443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045328.290494:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045328.290528:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045328.290549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045328.290581:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045328.290651:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808781952 00000100:00100000:1.0:1784045328.290661:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808781952 00000100:00100000:1.0:1784045328.290722:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 296 00000100:00100000:1.0:1784045328.290733:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808781952:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045328.290814:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808781952:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 71us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.290822:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 296 00000100:00100000:1.0:1784045328.290879:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782464 00000100:00100000:1.0:1784045328.290882:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782464 00000100:00100000:1.0:1784045328.290917:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782080 00000100:00100000:1.0:1784045328.290921:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782080 00000100:00100000:1.0:1784045328.290940:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:1.0:1784045328.290960:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2363:x1870706808782464:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045328.290993:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2363:x1870706808782464:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.290999:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:1.0:1784045328.291012:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:1.0:1784045328.291018:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2363:x1870706808782080:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045328.291044:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2363:x1870706808782080:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.291050:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:1.0:1784045328.291069:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782208 00000100:00100000:1.0:1784045328.291072:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782208 00000100:00100000:1.0:1784045328.291099:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782336 00000100:00100000:1.0:1784045328.291101:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782336 00000100:00100000:1.0:1784045328.291122:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784045328.291128:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808782208:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045328.291153:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808782208:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.291159:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784045328.291169:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1784045328.291175:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808782336:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045328.291197:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808782336:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.291203:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00080000:1.0:1784045328.291298:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045328.291314:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045328.291317:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045328.542622:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045328.542698:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782592 00000100:00100000:1.0:1784045328.542708:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782592 00000100:00100000:1.0:1784045328.542772:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:1.0:1784045328.542782:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:11313:x1870706808782592:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045328.542813:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045328.542866:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff37 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.542933:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.542948:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.542960:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.542975:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.542981:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.542988:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543270:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543278:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543291:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543296:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045328.543301:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543308:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543320:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045328.543324:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045328.543328:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543334:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543348:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543355:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543360:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543366:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045328.543369:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543385:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543393:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8aa91040da00) 00010000:00010000:1.0:1784045328.543395:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045328.543398:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543404:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d660 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543436:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d652 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff37 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543447:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045328.543449:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045328.543452:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff37 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.543462:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360e00, rc 0) 00000100:00100000:1.0:1784045328.543521:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:11313:x1870706808782592:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 739us (909us total) trans 0 rc 301/301 00000100:00100000:1.0:1784045328.543529:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:1.0:1784045328.556330:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045328.556431:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782848 00000100:00100000:3.0:1784045328.556441:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782848 00000100:00100000:3.0:1784045328.556502:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00100000:3.0:1784045328.556512:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:11313:x1870706808782848:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:3.0:1784045328.556578:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045328.556617:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f600/0xdb5b5ff6a2d2cfd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd70 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.556639:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045328.556644:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045328.556983:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.556998:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.557020:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.557057:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.557072:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 5 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045328.557088:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829761408:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045328.557177:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045328.564183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045328.564265:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808782976 00000100:00100000:0.0:1784045328.564274:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808782976 00010000:00010000:0.0:1784045328.564318:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 6 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045328.564369:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1784045328.564379:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2361:x1870706808782976:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045328.564394:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045328.564402:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 6 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045328.564415:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 6 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045328.564439:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045328.564445:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045328.564454:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045328.564462:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045328.564492:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045328.564544:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2361:x1870706808782976:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 167us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045328.564552:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00010000:00010000:3.0:1784045328.570188:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff29 expref: 5 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045328.570234:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829761408:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045328.570261:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.570272:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.570278:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.570307:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.570319:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.570490:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045328.572322:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784045328.572338:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.572418:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.572426:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.572431:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045328.572435:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.572443:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.572458:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045328.572461:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045328.572465:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.572471:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d667 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045328.572492:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032c6a292 reply state 0000000092a1ea57 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045328.572514:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045328.572726:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:11313:x1870706808782848:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 16211us (16401us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1784045328.572735:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 140 00010000:00010000:3.0:1784045328.578737:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.578756:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.578764:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.578770:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045328.578776:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.578784:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.578810:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8aa92210ce00) 00010000:00010000:3.0:1784045328.578814:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045328.578820:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.578856:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d66e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.625471:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045328.715707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045328.721221:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808783104 00000100:00100000:1.0:1784045328.721235:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808783104 00000100:00100000:1.0:1784045328.721315:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:1.0:1784045328.721326:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:11321:x1870706808783104:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:1.0:1784045328.721352:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045328.721375:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff3e expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.721443:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d67c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.721457:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d67c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.721469:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d67c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045328.721529:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784045328.721534:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045328.721564:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d67c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.721600:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff3e expref: 16 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.721622:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d67c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff3e expref: 15 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.721632:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045328.721635:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045328.721639:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360800, rc 0) 00000100:00100000:1.0:1784045328.721717:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:11321:x1870706808783104:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 391us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.721731:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:2.0:1784045328.800072:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045328.800196:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808783232 00000100:00100000:3.0:1784045328.800206:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808783232 00000100:00100000:3.0:1784045328.800274:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:3.0:1784045328.800283:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+15:11327:x1870706808783232:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045328.800302:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045328.800322:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff45 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800387:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800401:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800412:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800428:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800436:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800443:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800544:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800552:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800559:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045328.800611:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784045328.800615:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045328.800635:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800647:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800654:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800661:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800667:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045328.800672:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800680:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800693:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045328.800696:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045328.800700:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800706:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d68a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800721:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800738:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800744:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800748:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045328.800752:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800758:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800765:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8aa92210ce00) 00010000:00010000:3.0:1784045328.800768:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045328.800770:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800776:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d691 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800816:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff45 expref: 17 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800890:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff45 expref: 16 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.800898:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045328.800901:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784045328.800910:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045c00, rc 0) 00000100:00100000:3.0:1784045328.800979:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:11327:x1870706808783232:12345-192.168.201.58@tcp:101:bash.0 Request processed in 696us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045328.800987:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:2.0:1784045328.805272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045328.805675:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808783488 00000100:00100000:3.0:1784045328.805686:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808783488 00000100:00100000:3.0:1784045328.805749:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 143 00000100:00100000:3.0:1784045328.805759:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+16:11327:x1870706808783488:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045328.805780:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045328.805808:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d69f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff4c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806091:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806107:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806117:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806131:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806137:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806142:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045328.806716:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1784045328.806930:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806942:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806951:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806988:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.806995:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807002:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807008:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045328.807012:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807019:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807031:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045328.807034:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045328.807038:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807044:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d6a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045328.807069:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000318418e5 reply state 0000000065cd3d6c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045328.807078:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784045328.807108:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d69f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807124:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.807131:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:3.0:1784045328.807133:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045328.807135:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045328.810224:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11327:x1870706808783488:12345-192.168.201.58@tcp:101:bash.0 Request processed in 4455us (4954us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1784045328.810239:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 143 00010000:00010000:3.0:1784045328.823861:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.823881:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.823890:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.823896:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045328.823902:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.823932:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.823950:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa92210ce00) 00010000:00010000:3.0:1784045328.823953:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045328.823959:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.823965:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045328.826489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045328.826754:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808783616 00000100:00100000:1.0:1784045328.826764:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808783616 00000100:00100000:1.0:1784045328.826914:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1784045328.826924:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808783616:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784045328.826941:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045328.826962:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff53 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784045328.826988:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045328.827007:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1784045328.827012:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045328.827021:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.827039:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.827148:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360e00, rc 0) 00000100:00100000:1.0:1784045328.827236:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808783616:12345-192.168.201.58@tcp:101:bash.0 Request processed in 313us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.827243:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1784045328.833644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045328.834118:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808783744 00000100:00100000:1.0:1784045328.834128:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808783744 00000100:00100000:1.0:1784045328.834188:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:1.0:1784045328.834198:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:11327:x1870706808783744:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784045328.834234:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045328.834253:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff5a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.834294:0:6600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.834305:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045328.834309:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045328.834315:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.834352:0:6600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.834366:0:6600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045328.834380:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1870706829761536:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045328.834473:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045328.838319:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6600:1870706829761536:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045328.838357:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 7 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045328.838379:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361e00, rc 0) 00000100:00100000:1.0:1784045328.838462:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:11327:x1870706808783744:12345-192.168.201.58@tcp:101:bash.0 Request processed in 4264us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045328.838471:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:2.0:1784045328.840948:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045328.841114:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808783872 00000100:00100000:3.0:1784045328.841123:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808783872 00010000:00010000:3.0:1784045328.841163:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045328.841209:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:3.0:1784045328.841219:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808783872:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045328.841234:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045328.841257:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.841272:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.841297:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2d6c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff53 expref: 7 pid: 6598 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.841334:0:7496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045328.841349:0:7496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045328.841359:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 6 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.841368:0:7496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 6 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045328.841404:0:7496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 6 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045328.841433:0:7496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7496:1870706829761664:192.168.201.58@tcp:105: 00000100:00100000:3.0:1784045328.841515:0:7496:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045328.850506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045328.850627:0:7496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7496:1870706829761664:192.168.201.58@tcp:105: 00010000:00010000:3.0:1784045328.850652:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045328.850711:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808783872:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 9493us (9773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045328.850723:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:0.0:1784045328.850825:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808784128 00000100:00100000:0.0:1784045328.850870:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808784128 00000100:00100000:0.0:1784045328.850910:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:0.0:1784045328.850920:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:11327:x1870706808784128:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1784045328.851247:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11327:x1870706808784128:12345-192.168.201.58@tcp:35:bash.0 Request processed in 328us (751us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1784045328.851254:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:2.0:1784045329.005044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045329.005145:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808784384 00000100:00100000:0.0:1784045329.005156:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808784384 00000100:00100000:0.0:1784045329.005227:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:0.0:1784045329.005248:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11337:x1870706808784384:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045329.005275:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045329.005298:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d6d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff61 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045329.005436:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784045329.005556:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d6d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff61 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.005569:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:0.0:1784045329.005586:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045329.005592:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2d6d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff61 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.005606:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:0.0:1784045329.005671:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:11337:x1870706808784384:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 435us (637us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1784045329.005679:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:2.0:1784045329.011926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045329.012021:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808784640 00000100:00100000:0.0:1784045329.012031:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808784640 00000100:00100000:0.0:1784045329.012095:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:0.0:1784045329.012106:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:11337:x1870706808784640:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045329.012403:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11337:x1870706808784640:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 298us (484us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784045329.012411:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:2.0:1784045329.105179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.105406:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808784768 00000100:00100000:1.0:1784045329.105416:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808784768 00000100:00100000:1.0:1784045329.105720:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:1.0:1784045329.105731:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11343:x1870706808784768:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045329.105756:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045329.105774:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d6de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff68 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.105911:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d6e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.105926:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.105951:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045329.106015:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1784045329.106019:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045329.106041:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.106067:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d6de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff68 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.106088:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff68 expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.106112:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045329.106115:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045329.106119:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360000, rc 0) 00000100:00100000:1.0:1784045329.106182:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:11343:x1870706808784768:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 453us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045329.106189:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:2.0:1784045329.119448:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045329.119640:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808785024 00000100:00100000:3.0:1784045329.119650:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808785024 00000100:00100000:3.0:1784045329.119719:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:3.0:1784045329.119729:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:11343:x1870706808785024:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045329.119752:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045329.119773:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d6ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.120082:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.120097:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.120108:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045329.120121:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784045329.120484:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d6ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff6f expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.120506:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff6f expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.120516:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:3.0:1784045329.120519:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045329.120522:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044000, rc 0) 00000100:00100000:3.0:1784045329.120703:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11343:x1870706808785024:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 975us (1264us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1784045329.120712:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:2.0:1784045329.125595:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045329.125702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045329.125803:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808785152 00000100:00100000:0.0:1784045329.125816:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808785152 00000100:00100000:0.0:1784045329.125913:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784045329.125924:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:2360:x1870706808785152:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045329.125944:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045329.125970:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d6f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff6f expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.125989:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:0.0:1784045329.125995:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045329.126051:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:2360:x1870706808785152:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 130us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045329.126073:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784045329.126198:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808785408 00000100:00100000:1.0:1784045329.126203:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808785408 00000100:00100000:1.0:1784045329.126244:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:1.0:1784045329.126251:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11343:x1870706808785408:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045329.126271:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045329.126286:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff76 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.126375:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d708 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.126389:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.126399:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045329.126411:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784045329.126536:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff76 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.126567:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff76 expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.126574:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:1.0:1784045329.126577:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784045329.126579:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361400, rc 0) 00000100:00100000:1.0:1784045329.126619:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:11343:x1870706808785408:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 368us (917us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1784045329.126626:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:2.0:1784045329.130277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.130417:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808785536 00000100:00100000:1.0:1784045329.130429:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808785536 00000100:00100000:1.0:1784045329.130537:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784045329.130549:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2362:x1870706808785536:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:1.0:1784045329.130610:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.130632:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 6 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.130639:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045329.130644:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045329.130650:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.130686:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 6 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.130717:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 6 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045329.130732:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1870706829761792:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045329.130873:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045329.135916:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045329.136012:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808785664 00000100:00100000:2.0:1784045329.136022:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808785664 00002000:00100000:2.0:1784045329.136071:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8aa92d052d80 x1870706808785664/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:725/0 lens 504/0 e 0 to 0 dl 1784045340 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045329.136081:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa92d052d80 with x1870706808785664 ext(0->12) 00010000:00010000:2.0:1784045329.136089:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 7 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.136104:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 7 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045329.136111:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa92d052d80 00000100:00100000:2.0:1784045329.136137:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784045329.136144:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808785664:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:2.0:1784045329.136647:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2361:x1870706808785664:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 501us (738us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784045329.136664:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00002000:00100000:2.0:1784045329.136671:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8aa92d052d80 x1870706808785664/t4294967305(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:725/0 lens 504/448 e 0 to 0 dl 1784045340 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045329.136679:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa92d052d80 with x1870706808785664 ext(0->12) 00010000:00010000:2.0:1784045329.136684:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 9 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.136696:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 9 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045329.136702:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa92d052d80 00000100:00100000:1.0:1784045329.136955:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6599:1870706829761792:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045329.136979:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045329.140916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.141027:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808785792 00000100:00100000:1.0:1784045329.141037:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808785792 00010000:00010000:1.0:1784045329.141082:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 9 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045329.141125:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:1.0:1784045329.141135:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808785792:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045329.141150:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784045329.141171:0:5789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784045329.141174:0:5789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784045328 00002000:00010000:1.0:1784045329.141176:0:5789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784045329 00002000:00010000:1.0:1784045329.141178:0:5789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784045328 00010000:00010000:1.0:1784045329.141185:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 9 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.141229:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 9 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.141255:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063181294/0xdb5b5ff6a2d2d6c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff5a expref: 9 pid: 6600 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.141273:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045329.141278:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045329.141283:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.141294:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.141333:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045329.141394:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808785792:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 260us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045329.141402:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00010000:00010000:2.0:1784045329.141812:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141824:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141886:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141896:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141904:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141925:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045329.141929:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141940:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141955:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.141962:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2d716 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045329.142014:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2362:x1870706808785536:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 11468us (11747us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045329.142022:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1784045329.148399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.148481:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808786048 00000100:00100000:1.0:1784045329.148492:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808786048 00000100:00100000:1.0:1784045329.148549:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:1.0:1784045329.148560:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:11343:x1870706808786048:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:1.0:1784045329.148636:0:5808:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff76 expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045329.148948:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1784045329.148996:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1784045329.149509:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1784045329.149566:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.149581:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.149590:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.149626:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.149641:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 29 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045329.149657:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1870706829761920:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045329.149751:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045329.153389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045329.153864:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808786176 00000100:00100000:3.0:1784045329.153875:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808786176 00010000:00010000:3.0:1784045329.153921:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 30 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045329.153984:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1784045329.153995:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:2361:x1870706808786176:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045329.154010:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045329.154017:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 30 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.154029:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 30 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.154050:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:3.0:1784045329.154055:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.154064:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.154070:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.154089:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045329.154217:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:2361:x1870706808786176:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 225us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045329.154225:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00010000:00010000:1.0:1784045329.154394:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d6b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff4c expref: 29 pid: 5804 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045329.154411:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1870706829761920:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045329.154429:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.154449:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.154455:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045329.154596:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1784045329.154811:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1784045329.154948:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829762048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784045329.154998:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045329.155024:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045329.155888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829762048 00000100:00100000:3.0:1784045329.155896:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829762048 00000100:00100000:3.0:1784045329.155958:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045329.155968:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829762048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784045329.156062:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829762048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045329.156068:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1784045329.156216:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045329.156247:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829762048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1784045329.157178:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1784045329.157600:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829762176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784045329.157652:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045329.157813:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4b780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045329.161441:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829762176 00000100:00100000:3.0:1784045329.161456:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829762176 00000100:00100000:3.0:1784045329.161594:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045329.161605:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829762176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784045329.161881:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1870706829762176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 278us (4228us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784045329.161888:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045329.161965:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829762176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784045329.162031:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1784045329.162073:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.162084:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.162092:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.162114:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045329.162118:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.162126:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.162140:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:2.0:1784045329.162144:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784045329.162149:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.162155:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d71d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045329.162506:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784045329.162595:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1784045329.162604:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363848773386ns, next at 364848771794ns, rc = 0 00000001:00080000:2.0:1784045329.162609:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1784045329.162639:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210cd00) 00010000:00010000:2.0:1784045329.162641:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784045329.162648:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d708 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff76 expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045329.162739:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11343:x1870706808786048:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 14181us (14350us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1784045329.162747:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000020:00080000:2.0:1784045329.162750:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784045329.166463:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.166562:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808786304 00000100:00100000:1.0:1784045329.166572:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808786304 00000100:00100000:1.0:1784045329.166734:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:1.0:1784045329.166744:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11343:x1870706808786304:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045329.166778:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045329.166811:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d724 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff7d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.166902:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff7d expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.166929:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff7d expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.166950:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045329.166954:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045329.166957:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361e00, rc 0) 00000100:00100000:1.0:1784045329.167016:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:11343:x1870706808786304:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 273us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045329.167023:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:0.0:1784045329.171099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045329.171188:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808786560 00000100:00100000:2.0:1784045329.171197:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808786560 00000100:00100000:2.0:1784045329.171272:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784045329.171282:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:11343:x1870706808786560:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045329.171525:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11343:x1870706808786560:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 242us (435us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1784045329.171533:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784045329.268415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045329.269162:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808786816 00000100:00100000:3.0:1784045329.269177:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808786816 00000100:00100000:3.0:1784045329.269696:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:3.0:1784045329.269710:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11353:x1870706808786816:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045329.269740:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045329.269775:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d72b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff84 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045329.269931:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784045329.270050:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d72b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff84 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.270075:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045329.270078:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045329.270084:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d72b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff84 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.270119:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045e00, rc 0) 00000100:00100000:3.0:1784045329.270186:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11353:x1870706808786816:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 479us (1783us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1784045329.270195:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:2.0:1784045329.274462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.274946:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808786944 00000100:00100000:1.0:1784045329.274958:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808786944 00000100:00100000:1.0:1784045329.275045:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:1.0:1784045329.275055:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11353:x1870706808786944:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:1.0:1784045329.275138:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275156:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275168:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275184:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275191:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275229:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275351:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275360:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275368:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045329.275409:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275421:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275427:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275434:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275440:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045329.275445:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275452:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275463:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045329.275472:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045329.275477:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275483:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275499:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275505:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275512:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275516:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045329.275519:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275525:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275532:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa91040d600) 00010000:00010000:1.0:1784045329.275535:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045329.275538:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275544:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275558:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275570:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275707:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275714:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045329.275718:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275724:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275732:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045329.275735:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045329.275738:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.275744:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045329.275987:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11353:x1870706808786944:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 931us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045329.275996:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:0.0:1784045329.279006:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045329.279098:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808787200 00000100:00100000:2.0:1784045329.279107:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808787200 00000100:00100000:2.0:1784045329.279210:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:2.0:1784045329.279222:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11353:x1870706808787200:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045329.279670:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11353:x1870706808787200:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 449us (671us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1784045329.279679:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:2.0:1784045329.360153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045329.360408:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808787456 00000100:00100000:0.0:1784045329.360418:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808787456 00000100:00100000:0.0:1784045329.360948:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:0.0:1784045329.360960:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11356:x1870706808787456:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045329.360983:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045329.361002:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d74e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff8b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.361073:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.361087:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.361098:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.361112:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.361119:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.361142:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.363144:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.363164:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.363177:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045329.363190:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784045329.365065:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365081:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365088:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365103:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045329.365108:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365114:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365129:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045329.365132:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045329.365136:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365141:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32000/0xdb5b5ff6a2d2d755 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365154:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365160:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365166:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365171:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045329.365174:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365179:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365198:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa9118c5100) 00010000:00010000:1.0:1784045329.365200:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045329.365203:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365208:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d75c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365271:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d74e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365287:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.365295:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045329.365297:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045329.365300:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33200, rc 0) 00000100:00100000:1.0:1784045329.365603:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11356:x1870706808787456:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 4644us (5456us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1784045329.365613:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:2.0:1784045329.377584:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045329.378521:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808787584 00000100:00100000:3.0:1784045329.378533:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808787584 00000100:00100000:3.0:1784045329.378599:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:3.0:1784045329.378610:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11356:x1870706808787584:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784045329.378679:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378698:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378710:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378738:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378746:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378922:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378929:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045329.378933:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378952:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378964:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045329.378967:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045329.378973:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.378978:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d771 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045329.379055:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11356:x1870706808787584:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 446us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045329.379062:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:2.0:1784045329.383321:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.386945:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808787840 00000100:00100000:1.0:1784045329.386959:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808787840 00000100:00100000:1.0:1784045329.387030:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784045329.387040:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11356:x1870706808787840:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784045329.387272:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11356:x1870706808787840:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 233us (3960us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1784045329.387280:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000001:00080000:0.0:1784045329.418029:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000001:00080000:0.0:1784045329.418051:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967429 is committed 00000020:00080000:0.0:1784045329.418057:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa908a4b000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1784045329.418063:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa906a94400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa908a4bd80 00000020:00080000:0.0:1784045329.418067:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa906a94b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa90386c000 00000001:00080000:0.0:1784045329.418103:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:0.0:1784045329.418111:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1784045329.418262:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829762304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784045329.418338:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045329.418410:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829762304 00000100:00100000:0.0:1784045329.418417:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829762304 00000100:00100000:0.0:1784045329.418460:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784045329.418468:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1870706829762304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784045329.418493:0:8930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1784045329.418539:0:8930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a565f10, atime: 0x6a565f11, ctime: 0x6a565f10, blocks: 0x1 00010000:00010000:0.0:1784045329.418547:0:8930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.418564:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1784045329.418568:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045329.418586:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.418602:0:8930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.418611:0:8930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.418619:0:8930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.418637:0:8930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784045329.419134:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829762304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 666us (805us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784045329.419142:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1784045329.419168:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045329.419173:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.419182:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045329.419192:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.419201:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.419219:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.419226:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2d778 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045329.419243:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045329.419245:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045329.419247:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784045329.419278:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa93f7cd500/2, rc 0, transno 4294967307 00000100:00100000:0.0:1784045329.419285:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829762304:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1784045329.419587:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1784045329.419696:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1784045329.633084:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045329.655753:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.656047:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808788096 00000100:00100000:1.0:1784045329.656058:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808788096 00000100:00100000:1.0:1784045329.656127:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:1.0:1784045329.656137:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11387:x1870706808788096:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:1.0:1784045329.656165:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045329.656190:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d77f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff92 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.656305:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.656320:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.656332:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045329.656342:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784045329.656470:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d77f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff92 expref: 22 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.656496:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff92 expref: 21 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.656505:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045329.656508:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045329.656525:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361600, rc 0) 00000100:00100000:1.0:1784045329.656601:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11387:x1870706808788096:12345-192.168.201.58@tcp:101:cat.0 Request processed in 465us (858us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1784045329.656609:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:0.0:1784045329.668125:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045329.668225:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.668319:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808788480 00000100:00100000:1.0:1784045329.668340:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808788480 00000100:00100000:1.0:1784045329.668400:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1784045329.668409:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808788224 00000100:00100000:1.0:1784045329.668410:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11387:x1870706808788480:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:2.0:1784045329.668413:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808788224 00000100:00100000:2.0:1784045329.668463:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784045329.668480:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2360:x1870706808788224:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045329.668492:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045329.668515:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff92 expref: 22 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045329.668550:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:2.0:1784045329.668554:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045329.668616:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2360:x1870706808788224:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 146us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045329.668624:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045329.668672:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11387:x1870706808788480:12345-192.168.201.58@tcp:35:cat.0 Request processed in 263us (445us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784045329.668679:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784045329.732761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045329.733126:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808788736 00000100:00100000:1.0:1784045329.733136:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808788736 00000100:00100000:1.0:1784045329.733189:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:1.0:1784045329.733200:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11393:x1870706808788736:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:1.0:1784045329.733226:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045329.733229:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784045329.733256:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d6e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff68 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.733274:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045329.733279:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045329.733291:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d794 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fff99 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.733385:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.733415:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.733424:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.733456:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.733529:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 21 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045329.733545:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829762432:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045329.733685:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045329.741676:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829762432:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045329.741708:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045329.741904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045329.742109:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808788864 00000100:00100000:3.0:1784045329.742116:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808788864 00010000:00010000:3.0:1784045329.742154:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 22 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045329.742197:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:3.0:1784045329.742216:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2360:x1870706808788864:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045329.742231:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045329.742237:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 22 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.742250:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 22 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.742292:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2d763 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff8b expref: 22 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.742307:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045329.742312:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.742320:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.742334:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.742495:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045329.742553:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:2360:x1870706808788864:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 339us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045329.742561:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00010000:00010000:1.0:1784045329.743553:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.743568:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045329.743601:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784045329.743762:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d794 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.743822:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045329.743865:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045329.743868:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784045329.743872:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361400, rc 0) 00000100:00100000:1.0:1784045329.743919:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11393:x1870706808788736:12345-192.168.201.58@tcp:101:dd.0 Request processed in 10721us (11170us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1784045329.743939:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:0.0:1784045329.747921:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045329.748083:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808789120 00000100:00100000:3.0:1784045329.748093:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808789120 00000100:00100000:3.0:1784045329.748195:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 155 00000100:00100000:3.0:1784045329.748218:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11393:x1870706808789120:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:3.0:1784045329.748485:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.748502:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.748513:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045329.748592:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1784045329.748618:0:7507:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000412bec62 reply state 00000000ef1d8323 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045329.748628:0:7507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045329.748731:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11393:x1870706808789120:12345-192.168.201.58@tcp:36:dd.0 Request processed in 526us (818us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1784045329.748739:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 155 00000020:00080000:3.0:1784045329.748745:0:7507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045329.755148:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.755167:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.755176:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.755181:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045329.755186:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.755193:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.755212:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045329.755215:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045329.755220:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045329.755226:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045329.825302:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829762560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045329.825399:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045329.825592:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829762560 00000100:00100000:0.0:1784045329.825601:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829762560 00000100:00100000:0.0:1784045329.825668:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784045329.825679:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9378b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829762560:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784045329.825945:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784045329.826028:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045329.826108:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9378b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829762560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 430us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045329.826117:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784045329.826496:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829762560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045330.086933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.087041:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808789248 00000100:00100000:2.0:1784045330.087051:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808789248 00000100:00100000:2.0:1784045330.087132:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:2.0:1784045330.087143:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11407:x1870706808789248:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:2.0:1784045330.087168:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045330.087188:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d7b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffa0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087266:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087281:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087292:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087308:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087313:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087336:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087657:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087666:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087671:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087698:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.087709:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 24 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045330.087719:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829762688:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045330.087823:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971300 going to sleep for 11 seconds 00000100:00080000:3.0:1784045330.088493:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045330.091533:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.091683:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808789504 00000100:00100000:3.0:1784045330.091693:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808789504 00000100:00100000:3.0:1784045330.091759:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:3.0:1784045330.091777:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:6038:x1870706808789504:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784045330.092096:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:6038:x1870706808789504:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 330us (573us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1784045330.092102:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784045330.092532:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829762688:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045330.092561:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045330.095934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.096045:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808789632 00000100:00100000:3.0:1784045330.096055:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808789632 00010000:00010000:3.0:1784045330.096096:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 26 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.096142:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:3.0:1784045330.096152:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:2360:x1870706808789632:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045330.096167:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045330.096174:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 26 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.096187:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 26 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.096241:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d79b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fff99 expref: 26 pid: 5805 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.096261:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.096266:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.096276:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.096283:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.096327:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045330.096386:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:2360:x1870706808789632:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 235us (459us total) trans 0 rc 0/0 00010000:00010000:1.0:1784045330.096392:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.096393:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00010000:00010000:1.0:1784045330.096399:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045330.096441:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784045330.096445:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045330.096469:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096481:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096490:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096496:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096512:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096518:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045330.096522:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096529:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096538:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045330.096541:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045330.096544:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096551:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d7b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096568:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096583:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096589:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096593:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045330.096596:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096611:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096620:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0700) 00010000:00010000:1.0:1784045330.096623:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045330.096626:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096631:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d7be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096667:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d7b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa0 expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096681:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa0 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.096687:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045330.096690:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045330.096692:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:1.0:1784045330.096733:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11407:x1870706808789248:12345-192.168.201.58@tcp:101:stat.0 Request processed in 9592us (9808us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045330.096741:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:0.0:1784045330.169303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.169406:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808789888 00000100:00100000:2.0:1784045330.169418:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808789888 00000100:00100000:2.0:1784045330.169483:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:2.0:1784045330.169492:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11413:x1870706808789888:12345-192.168.201.58@tcp:36:truncate.0 00010000:00010000:2.0:1784045330.169575:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045330.169606:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa0 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.169625:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:2.0:1784045330.169631:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045330.169902:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.169926:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.169938:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045330.169990:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1784045330.170015:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000aa62cd3 reply state 00000000387e9fed transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045330.170024:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045330.170124:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11413:x1870706808789888:12345-192.168.201.58@tcp:36:truncate.0 Request processed in 632us (829us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1784045330.170133:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 157 00000020:00080000:2.0:1784045330.170138:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045330.173341:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.173359:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.173367:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.173373:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.173378:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.173402:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.173419:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.173422:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.173426:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.173433:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d7cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045330.313139:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.313238:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808790016 00000100:00100000:3.0:1784045330.313247:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808790016 00000100:00100000:3.0:1784045330.313310:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:3.0:1784045330.313331:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:11427:x1870706808790016:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:3.0:1784045330.313357:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045330.313380:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffa7 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313449:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313463:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313473:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313491:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313519:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313526:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313947:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313958:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.313966:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045330.313999:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1784045330.314003:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045330.314023:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314036:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314044:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314050:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314056:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314072:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.314077:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314085:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314097:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045330.314100:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.314105:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314111:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d7da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314125:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314132:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314138:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314143:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.314145:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314150:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314169:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa92210c100) 00010000:00010000:3.0:1784045330.314171:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.314174:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314180:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d7e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314212:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d7d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 27 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314227:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 26 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.314234:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.314235:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045330.314238:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045330.314310:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11427:x1870706808790016:12345-192.168.201.58@tcp:101:stat.0 Request processed in 982us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045330.314319:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:0.0:1784045330.424592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045330.424886:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808790272 00000100:00100000:1.0:1784045330.424898:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808790272 00000100:00100000:1.0:1784045330.424971:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 159 00000100:00100000:1.0:1784045330.424981:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11437:x1870706808790272:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045330.425017:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045330.425037:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffae expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045330.425666:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1784045330.425970:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d7ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffae expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.425986:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:1.0:1784045330.425990:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045330.425995:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffae expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.426011:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360000, rc 0) 00000100:00100000:1.0:1784045330.426140:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:11437:x1870706808790272:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1160us (1559us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1784045330.426148:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 159 00000100:00100000:0.0:1784045330.442796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.452882:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808790528 00000100:00100000:3.0:1784045330.452898:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808790528 00000100:00100000:3.0:1784045330.452969:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:3.0:1784045330.452979:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:11437:x1870706808790528:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045330.453736:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11437:x1870706808790528:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 755us (10945us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784045330.453746:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784045330.560795:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.560979:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808790784 00000100:00100000:2.0:1784045330.560989:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808790784 00000100:00100000:2.0:1784045330.561055:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 160 00000100:00100000:2.0:1784045330.561067:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11443:x1870706808790784:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045330.561096:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045330.561135:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffb5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.561251:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.561263:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 29 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.561271:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.561308:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 29 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.561316:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 29 pid: 7507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045330.561328:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829762816:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045330.561415:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971300 going to sleep for 11 seconds 00000100:00100000:1.0:1784045330.564206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045330.564296:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808790912 00000100:00100000:0.0:1784045330.564305:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808790912 00010000:00010000:0.0:1784045330.564345:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 30 pid: 7507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045330.564386:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:0.0:1784045330.564395:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:2361:x1870706808790912:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045330.564410:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045330.564417:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 30 pid: 7507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.564429:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 30 pid: 7507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.564452:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:0.0:1784045330.564458:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.564496:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.564503:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.564522:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045330.564577:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+30:2361:x1870706808790912:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 179us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045330.564584:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00010000:00010000:2.0:1784045330.564697:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d7e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffa7 expref: 29 pid: 7507 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045330.564715:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829762816:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045330.564739:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.564748:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.564777:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045330.564796:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1784045330.564988:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d7fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.565005:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.565013:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:2.0:1784045330.565016:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045330.565019:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045330.565055:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:11443:x1870706808790784:12345-192.168.201.58@tcp:101:bash.0 Request processed in 3992us (4271us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1784045330.565063:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 160 00000100:00100000:1.0:1784045330.568056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.568114:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808791168 00000100:00100000:3.0:1784045330.568124:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808791168 00000100:00100000:3.0:1784045330.568218:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 161 00000100:00100000:3.0:1784045330.568228:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:11443:x1870706808791168:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:3.0:1784045330.568496:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.568516:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.568528:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045330.568597:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1784045330.568622:0:7507:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2408199 reply state 00000000624bc253 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.568632:0:7507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045330.568725:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11443:x1870706808791168:12345-192.168.201.58@tcp:36:bash.0 Request processed in 497us (678us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1784045330.568732:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 161 00000020:00080000:3.0:1784045330.568738:0:7507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784045330.574095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045330.574169:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808791296 00000100:00100000:1.0:1784045330.574180:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808791296 00000100:00100000:1.0:1784045330.574261:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:1.0:1784045330.574272:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11443:x1870706808791296:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784045330.574299:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045330.574326:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffbc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574428:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574445:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574453:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574461:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574480:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574507:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.574521:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045330.574534:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829762944:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045330.574679:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908a4bc00 going to sleep for 11 seconds 00010000:00010000:3.0:1784045330.574717:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574726:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574730:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574733:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.574741:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574746:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574757:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.574759:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.574771:0:3304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574779:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.574785:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d812 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045330.576996:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.577025:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829762944:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045330.577053:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.577195:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808791424 00000100:00100000:3.0:1784045330.577203:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808791424 00010000:00010000:3.0:1784045330.577247:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.577288:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:3.0:1784045330.577299:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:2361:x1870706808791424:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045330.577315:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045330.577322:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.577334:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.577374:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d804 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffb5 expref: 33 pid: 5805 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.577390:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.577405:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.577416:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.577424:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.577450:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045330.577471:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.577478:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.577514:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:2361:x1870706808791424:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 216us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045330.577523:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000004:00200000:1.0:1784045330.577527:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784045330.577531:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045330.577550:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.577574:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffbc expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.577588:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffbc expref: 31 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.577593:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045330.577595:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045330.577597:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361a00, rc 0) 00000100:00100000:1.0:1784045330.577615:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:11443:x1870706808791296:12345-192.168.201.58@tcp:101:bash.0 Request processed in 3348us (3531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045330.577620:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:0.0:1784045330.588952:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.589086:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808791680 00000100:00100000:3.0:1784045330.589097:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808791680 00000100:00100000:3.0:1784045330.589195:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:3.0:1784045330.589206:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:11443:x1870706808791680:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1784045330.589458:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11443:x1870706808791680:12345-192.168.201.58@tcp:35:bash.0 Request processed in 253us (515us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784045330.589466:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000040:00080000:3.0:1784045330.659110:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045330.659118:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045330.659509:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1784045330.659522:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784045330.660137:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045330.678653:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.678979:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808791936 00000100:00100000:2.0:1784045330.678990:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808791936 00000100:00100000:2.0:1784045330.679044:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:2.0:1784045330.679052:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11453:x1870706808791936:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045330.679072:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045330.679088:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffc3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045330.679314:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1784045330.679459:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d827 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffc3 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.679471:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045330.679473:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045330.679476:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffc3 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.679485:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045330.679537:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:11453:x1870706808791936:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 486us (895us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1784045330.679542:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:1.0:1784045330.684997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.685075:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808792064 00000100:00100000:3.0:1784045330.685086:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808792064 00000100:00100000:3.0:1784045330.685154:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 164 00000100:00100000:3.0:1784045330.685166:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:11453:x1870706808792064:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784045330.685256:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685273:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685285:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685300:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685306:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685312:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685695:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685705:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685712:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045330.685756:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685788:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685794:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685801:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685807:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.685812:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685819:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685876:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045330.685879:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.685884:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685891:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d835 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685902:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685909:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685915:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685927:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.685930:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685936:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685944:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa92210c100) 00010000:00010000:3.0:1784045330.685947:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.685949:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685955:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d83c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685972:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685978:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685984:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685989:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045330.685992:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.685998:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.686016:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.686018:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045330.686021:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.686026:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045330.686110:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:11453:x1870706808792064:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 945us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045330.686120:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 164 00000100:00100000:0.0:1784045330.689068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.689152:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808792320 00000100:00100000:3.0:1784045330.689164:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808792320 00000100:00100000:1.0:1784045330.689665:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:1.0:1784045330.689681:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+33:11453:x1870706808792320:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784045330.690104:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11453:x1870706808792320:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 428us (1047us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1784045330.690112:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784045330.737227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045330.737957:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808792576 00000100:00100000:1.0:1784045330.737969:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808792576 00000100:00100000:1.0:1784045330.738042:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 165 00000100:00100000:1.0:1784045330.738066:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11456:x1870706808792576:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045330.738093:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045330.738113:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d84a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffca expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738185:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738214:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738226:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738243:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738251:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738257:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.738663:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d85f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.739391:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.739401:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045330.739428:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784045330.740081:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740093:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740100:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740107:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045330.740112:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740120:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740133:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045330.740136:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045330.740141:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740146:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360c00/0xdb5b5ff6a2d2d851 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740163:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740169:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740186:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740191:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045330.740194:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740210:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740218:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa91040d600) 00010000:00010000:1.0:1784045330.740221:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045330.740224:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740229:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d858 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740283:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d84a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffca expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740299:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d85f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffca expref: 36 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045330.740318:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:1.0:1784045330.740322:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045330.740326:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361200, rc 0) 00000100:00100000:1.0:1784045330.740818:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11456:x1870706808792576:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2751us (3600us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1784045330.740884:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 165 00000100:00100000:0.0:1784045330.750576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045330.750623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.750722:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808792832 00000100:00100000:2.0:1784045330.750732:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808792832 00000100:00100000:2.0:1784045330.750813:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:2.0:1784045330.750823:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11456:x1870706808792832:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784045330.750936:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.750957:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.750969:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751003:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751025:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751032:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751038:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045330.751043:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751051:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751063:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:2.0:1784045330.751066:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045330.751070:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.751077:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d86d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045330.751164:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11456:x1870706808792832:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 341us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045330.751172:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:3.0:1784045330.751320:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808792704 00000100:00100000:3.0:1784045330.751324:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808792704 00000100:00100000:3.0:1784045330.751367:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784045330.751375:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:2361:x1870706808792704:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045330.751385:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045330.751401:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361200/0xdb5b5ff6a2d2d85f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffca expref: 36 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.751413:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.751416:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045330.751452:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:2361:x1870706808792704:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 79us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045330.751458:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784045330.755233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.755585:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808793088 00000100:00100000:3.0:1784045330.755608:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808793088 00000100:00100000:3.0:1784045330.755664:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1784045330.755674:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11456:x1870706808793088:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045330.755931:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11456:x1870706808793088:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 257us (705us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1784045330.755940:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1784045330.946391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.946489:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808793344 00000100:00100000:3.0:1784045330.946498:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808793344 00000100:00100000:3.0:1784045330.946565:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:3.0:1784045330.946576:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11475:x1870706808793344:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:3.0:1784045330.946602:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045330.946624:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d874 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffd1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.946735:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d87b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.946771:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d87b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.946783:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d87b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045330.946796:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784045330.946951:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffd1 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.946970:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d87b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffd1 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.946995:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.946998:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784045330.947002:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044000, rc 0) 00000100:00100000:3.0:1784045330.947066:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11475:x1870706808793344:12345-192.168.201.58@tcp:101:cat.0 Request processed in 491us (683us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1784045330.947081:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:1.0:1784045330.968421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045330.968533:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808793472 00000100:00100000:2.0:1784045330.968543:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808793472 00000100:00100000:2.0:1784045330.968613:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:2.0:1784045330.968623:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11476:x1870706808793472:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045330.968649:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045330.968683:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffd8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.968752:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.968778:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.968790:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045330.969031:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1784045330.969035:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045330.969110:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.969138:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffd8 expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.969155:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffd8 expref: 39 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045330.969164:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045330.969167:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045330.969171:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045330.969228:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11476:x1870706808793472:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 606us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045330.969236:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:1.0:1784045330.973281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.973365:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808793856 00000100:00100000:3.0:1784045330.973376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808793856 00000100:00100000:3.0:1784045330.973441:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1784045330.973451:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11476:x1870706808793856:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045330.973804:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11476:x1870706808793856:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 353us (532us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1784045330.973811:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784045330.985091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045330.985182:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808793984 00000100:00100000:3.0:1784045330.985192:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808793984 00000100:00100000:3.0:1784045330.985260:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784045330.985270:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11476:x1870706808793984:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:3.0:1784045330.985286:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784045330.985311:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2d820 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffbc expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.985334:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d87b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffd1 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.985351:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2d724 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff7d expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045330.985376:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:3.0:1784045330.985386:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045330.985440:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11476:x1870706808793984:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 171us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045330.985448:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784045330.987271:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045330.987483:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808794112 00000100:00100000:0.0:1784045330.987492:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808794112 00000100:00100000:0.0:1784045330.987541:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 169 00000100:00100000:0.0:1784045330.987557:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11476:x1870706808794112:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:0.0:1784045330.987680:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.987697:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045330.987715:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045330.988048:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1784045330.988123:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11476:x1870706808794112:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 573us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045330.988131:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 169 00000100:00100000:0.0:1784045331.008767:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045331.014949:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808794240 00000100:00100000:1.0:1784045331.014966:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808794240 00000100:00100000:1.0:1784045331.015051:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 170 00000100:00100000:1.0:1784045331.015062:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11478:x1870706808794240:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045331.015083:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045331.015105:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d89e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffdf expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.015177:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.015192:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.015217:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.015233:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.015240:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.015245:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.017973:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.017994:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018006:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045331.018053:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1784045331.018057:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045331.018078:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018091:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018101:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018108:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018115:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018121:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045331.018126:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018134:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018155:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045331.018159:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045331.018164:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018170:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2d8a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018186:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018193:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018199:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018204:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045331.018207:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018213:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018221:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa91040d600) 00010000:00010000:1.0:1784045331.018224:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045331.018227:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018233:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2d8ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018287:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d89e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 39 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018303:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 38 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.018311:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045331.018313:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045331.018316:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361600, rc 0) 00000100:00100000:1.0:1784045331.018401:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11478:x1870706808794240:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 3340us (9651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.018409:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 170 00000001:00080000:2.0:1784045331.507487:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1784045331.507510:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1784045331.681406:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045331.695702:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045331.695711:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045331.695777:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784045331.695784:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045331.696158:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829763072:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784045331.696252:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93f6f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045331.704350:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829763072:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784045331.710651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045331.711627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808794368 00000100:00100000:0.0:1784045331.711636:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808794368 00000100:00100000:0.0:1784045331.711701:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:0.0:1784045331.711709:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11489:x1870706808794368:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784045331.711737:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784045331.711861:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11489:x1870706808794368:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 151us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.711869:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:2.0:1784045331.728633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.728893:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808794496 00000100:00100000:3.0:1784045331.728903:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808794496 00000100:00100000:3.0:1784045331.728961:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:3.0:1784045331.728972:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11489:x1870706808794496:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784045331.729049:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729066:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729079:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729093:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729100:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729107:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729151:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729161:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729167:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045331.729206:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784045331.729210:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045331.729224:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729236:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729242:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729248:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729253:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045331.729257:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729264:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729275:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:3.0:1784045331.729284:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045331.729290:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729296:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d8ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729312:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729318:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729323:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729329:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045331.729332:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729337:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729345:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8aa92210cf00) 00010000:00010000:3.0:1784045331.729348:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045331.729351:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729356:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d8c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729371:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729384:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729391:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729575:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045331.729578:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729584:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729592:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:3.0:1784045331.729595:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045331.729598:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.729603:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045331.729680:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11489:x1870706808794496:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 709us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.729688:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:0.0:1784045331.737856:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.737928:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808794752 00000100:00100000:3.0:1784045331.737938:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808794752 00000100:00100000:3.0:1784045331.738000:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:3.0:1784045331.738011:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11489:x1870706808794752:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045331.738030:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045331.738065:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d8cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffe6 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738167:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738182:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738193:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045331.738205:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784045331.738300:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738308:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738313:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738320:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045331.738324:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738332:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738344:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:3.0:1784045331.738347:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045331.738352:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738369:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738427:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d8cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffe6 expref: 40 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738437:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:3.0:1784045331.738439:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045331.738443:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d8cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffe6 expref: 40 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.738453:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942172400, rc 0) 00000100:00100000:3.0:1784045331.738518:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11489:x1870706808794752:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 509us (686us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1784045331.738526:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:0.0:1784045331.759583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045331.759633:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808794880 00000100:00100000:1.0:1784045331.759644:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808794880 00000100:00100000:0.0:1784045331.760136:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 174 00000100:00100000:0.0:1784045331.760153:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11489:x1870706808794880:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784045331.760204:0:7507:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784045331.760315:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11489:x1870706808794880:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 162us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.760323:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 174 00000100:00100000:0.0:1784045331.770855:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.776971:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808795136 00000100:00100000:3.0:1784045331.776991:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808795136 00000100:00100000:3.0:1784045331.777072:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:3.0:1784045331.777084:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11489:x1870706808795136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045331.777107:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045331.777111:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045331.777138:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffd8 expref: 39 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.777161:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045331.777167:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045331.777198:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d8e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217fffed expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045331.778031:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1784045331.778299:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.778315:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.778327:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.778386:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d8e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffed expref: 41 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.778404:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffed expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.778413:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa92210cf00) 00010000:00010000:3.0:1784045331.778416:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045331.778419:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173600, rc 0) 00000100:00100000:3.0:1784045331.778495:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11489:x1870706808795136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1414us (7671us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1784045331.778504:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:1.0:1784045331.793915:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045331.793960:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808795392 00000100:00100000:2.0:1784045331.793970:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808795392 00000100:00100000:2.0:1784045331.794038:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:2.0:1784045331.794048:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11489:x1870706808795392:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784045331.794102:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045331.794129:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d8eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffed expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794147:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa92210cf00) 00010000:00010000:2.0:1784045331.794156:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045331.794189:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794203:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794213:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794263:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794270:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794276:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794577:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794585:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794591:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794598:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045331.794603:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794611:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794620:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045331.794624:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045331.794628:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794634:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d8f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794643:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794648:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794654:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794666:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045331.794669:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794675:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794683:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7196cc5c (ffff8aa902ec0e00) 00010000:00010000:2.0:1784045331.794685:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045331.794688:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.794694:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2d900 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7196cc5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045331.794807:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11489:x1870706808795392:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 759us (901us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045331.794815:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:0.0:1784045331.808080:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045331.808197:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808795520 00000100:00100000:1.0:1784045331.808207:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808795520 00000100:00100000:1.0:1784045331.808269:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:1.0:1784045331.808277:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11489:x1870706808795520:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045331.808305:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045331.808333:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d907 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffff4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.808373:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.808387:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.808414:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.808501:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2d907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 41 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.808517:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.808526:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:1.0:1784045331.808529:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784045331.808531:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360e00, rc 0) 00000100:00100000:1.0:1784045331.808584:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11489:x1870706808795520:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 308us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.808591:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:1.0:1784045331.814490:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.814605:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808795776 00000100:00100000:3.0:1784045331.814617:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808795776 00000100:00100000:3.0:1784045331.814691:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 178 00000100:00100000:3.0:1784045331.814701:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11489:x1870706808795776:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045331.814855:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.814873:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.814885:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045331.815208:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1784045331.815219:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366501388069ns, next at 367501386084ns, rc = 0 00000004:00010000:3.0:1784045331.815376:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e57fab50 reply state 000000004ca5e690 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045331.815387:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045331.815501:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:11489:x1870706808795776:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 800us (1021us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1784045331.815509:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 178 00010000:00010000:3.0:1784045331.821222:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821241:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821249:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821255:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045331.821259:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821282:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821300:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:3.0:1784045331.821303:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784045331.821308:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821314:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d915 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045331.821504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.821561:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808795904 00000100:00100000:3.0:1784045331.821571:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808795904 00000100:00100000:3.0:1784045331.821626:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179 00000100:00100000:3.0:1784045331.821637:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:11489:x1870706808795904:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045331.821672:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045331.821691:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055217ffffb expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821759:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 42 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821774:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 42 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.821793:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:3.0:1784045331.821795:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045331.821798:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173600, rc 0) 00000100:00100000:3.0:1784045331.821891:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:11489:x1870706808795904:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 254us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.821898:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179 00000100:00100000:1.0:1784045331.824200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045331.824263:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808796032 00000100:00100000:2.0:1784045331.824273:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808796032 00000100:00080000:3.0:1784045331.824356:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045331.824366:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784045331.824377:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808796032:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784045331.824695:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808796032:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 320us (503us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1784045331.824703:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784045331.840546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.840628:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808796288 00000100:00100000:3.0:1784045331.840638:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808796288 00000100:00100000:3.0:1784045331.840720:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:3.0:1784045331.840731:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:11489:x1870706808796288:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045331.841005:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11489:x1870706808796288:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 275us (469us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1784045331.841013:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784045331.844393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045331.845075:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808796544 00000100:00100000:0.0:1784045331.845088:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808796544 00000100:00100000:0.0:1784045331.845157:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:0.0:1784045331.845173:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11489:x1870706808796544:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784045331.845297:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11489:x1870706808796544:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 123us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.845305:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:0.0:1784045331.847468:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.847527:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808796672 00000100:00100000:3.0:1784045331.847536:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808796672 00000100:00100000:3.0:1784045331.847606:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:3.0:1784045331.847615:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11489:x1870706808796672:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045331.847636:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045331.847668:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d923 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800002 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.847751:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d92a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.847767:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.847781:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045331.847868:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045331.847890:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.847919:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2d923 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800002 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.847937:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800002 expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045331.847946:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:3.0:1784045331.847949:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784045331.847953:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044a00, rc 0) 00000100:00100000:3.0:1784045331.848005:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:11489:x1870706808796672:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 391us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.848012:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:2.0:1784045331.852024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045331.852122:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808796800 00000100:00100000:0.0:1784045331.852132:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808796800 00000100:00100000:0.0:1784045331.852216:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784045331.852225:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808796800:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045331.852242:0:8930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045331.852262:0:8930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800009 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045331.852301:0:8930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f13, blocks: 0x1 00010000:00010000:0.0:1784045331.852328:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1784045331.852338:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045331.852347:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 8 pid: 8930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045331.852368:0:8930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 8 pid: 8930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045331.852383:0:8930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:0.0:1784045331.852447:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808796800:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 223us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.852455:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:1.0:1784045331.855564:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045331.855642:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797056 00000100:00100000:3.0:1784045331.855666:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797056 00000100:00100000:3.0:1784045331.855727:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:3.0:1784045331.855738:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:11489:x1870706808797056:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045331.855887:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:11489:x1870706808797056:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 150us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.855894:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:2.0:1784045331.858932:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045331.859018:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797184 00000100:00100000:1.0:1784045331.859028:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797184 00000100:00100000:1.0:1784045331.859086:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1784045331.859095:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:11489:x1870706808797184:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045331.859113:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045331.859132:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800010 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.859176:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.859186:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045331.859190:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045331.859196:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.859235:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.859252:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045331.859267:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93b5a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829763200:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045331.859358:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9222e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045331.863670:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93b5a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829763200:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045331.863709:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 9 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045331.863729:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361200, rc 0) 00000100:00100000:1.0:1784045331.863802:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:11489:x1870706808797184:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 4707us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.863812:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:0.0:1784045331.865860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045331.865959:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797312 00000100:00100000:2.0:1784045331.865968:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797312 00010000:00010000:2.0:1784045331.866008:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045331.866053:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1784045331.866062:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808797312:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045331.866076:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045331.866096:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.866111:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.866132:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2d931 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800009 expref: 9 pid: 8930 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.866147:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045331.866151:0:7497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045331.866160:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.866183:0:7497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045331.866250:0:7497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045331.866264:0:7497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7497:1870706829763328:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784045331.866528:0:7497:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045331.871624:0:7497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7497:1870706829763328:192.168.201.58@tcp:105: 00010000:00010000:0.0:1784045331.871654:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045331.871714:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808797312:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 5652us (5882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.871725:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:3.0:1784045331.873085:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829763968:0@lo:400:kworker.0 00000100:00100000:2.0:1784045331.873097:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829763584:0@lo:400:kworker.0 00000100:00100000:1.0:1784045331.873160:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829763456:0@lo:400:kworker.0 00000100:00100000:0.0:1784045331.877585:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829763712:0@lo:400:kworker.0 00000100:00100000:2.0:1784045331.878024:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045331.878070:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829764096:0@lo:400:kworker.0 00000100:00100000:2.0:1784045331.878099:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045331.878147:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829763584 00000100:00100000:2.0:1784045331.878154:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829763584 00000100:00100000:2.0:1784045331.878220:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829764096 00000100:00100000:2.0:1784045331.878224:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829764096 00000100:00100000:2.0:1784045331.878256:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784045331.878265:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829763584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045331.878441:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829763584:12345-0@lo:400:kworker.0 Request processed in 175us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045331.878449:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784045331.878465:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784045331.878472:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829764096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045331.878499:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829764096:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045331.878505:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1784045331.878524:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045331.878571:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829763584:0@lo:400:kworker.0 00000100:00100000:2.0:1784045331.878582:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829764096:0@lo:400:kworker.0 00000100:00100000:3.0:1784045331.879031:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045331.879093:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829763968 00000100:00100000:3.0:1784045331.879098:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829763968 00000100:00100000:3.0:1784045331.879130:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784045331.879136:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045331.879175:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829763968:12345-0@lo:400:kworker.0 Request processed in 39us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.879181:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784045331.879211:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829763968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045331.879622:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045331.879859:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829763840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045331.879897:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045331.879980:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829763456 00000100:00100000:3.0:1784045331.879985:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829763456 00000100:00080000:2.0:1784045331.880077:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045331.880121:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045331.880143:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797440 00000100:00100000:2.0:1784045331.880146:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797440 00002000:00100000:2.0:1784045331.880192:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8aa939f4f800 x1870706808797440/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:727/0 lens 504/0 e 0 to 0 dl 1784045342 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045331.880204:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa939f4f800 with x1870706808797440 ext(0->8) 00002000:00010000:2.0:1784045331.880209:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa939f4f800 00000100:00100000:2.0:1784045331.880227:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1784045331.880235:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808797440:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784045331.880298:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1784045331.880306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829763456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045331.880349:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829763456:12345-0@lo:400:kworker.0 Request processed in 44us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.880355:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784045331.880778:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:2361:x1870706808797440:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 543us (658us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784045331.880787:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00002000:00100000:2.0:1784045331.880794:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8aa939f4f800 x1870706808797440/t4294967314(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:727/0 lens 504/448 e 0 to 0 dl 1784045342 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045331.880802:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa939f4f800 with x1870706808797440 ext(0->8) 00002000:00010000:2.0:1784045331.880805:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa939f4f800 00000100:00100000:3.0:1784045331.881365:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829763840 00000100:00100000:3.0:1784045331.881370:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829763840 00000100:00100000:3.0:1784045331.881465:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045331.881473:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829763840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045331.881496:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045331.881535:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829763840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.881595:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045331.881919:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829763456:0@lo:400:kworker.0 00000100:00100000:3.0:1784045331.881931:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1784045331.881937:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1784045331.881965:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa93f7cd500, transno 4294967307 00000100:00080000:2.0:1784045331.882159:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045331.882219:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829763840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045331.887343:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045331.887447:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797568 00000100:00100000:2.0:1784045331.887457:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797568 00000100:00100000:2.0:1784045331.887565:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 183 00000100:00100000:2.0:1784045331.887576:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+44:11489:x1870706808797568:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1784045331.897968:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045331.898929:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829764224:0@lo:400:kworker.0 00000100:00100000:0.0:1784045331.898980:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045331.899011:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829764224 00000100:00100000:0.0:1784045331.899018:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829764224 00000100:00100000:0.0:1784045331.899064:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045331.899072:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829764224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045331.899121:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829764224:12345-0@lo:400:kworker.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.899134:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045331.899194:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829764224:0@lo:400:kworker.0 00000100:00100000:3.0:1784045331.899722:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829763712 00000100:00100000:3.0:1784045331.899728:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829763712 00000100:00100000:3.0:1784045331.899787:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784045331.899795:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829763712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045331.899859:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829763712:12345-0@lo:400:kworker.0 Request processed in 65us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045331.899865:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1784045331.899932:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045331.899955:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829763712:0@lo:400:kworker.0 00000001:00080000:0.0:1784045332.020911:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000100:00100000:2.0:1784045332.022676:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11489:x1870706808797568:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 135092us (135333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045332.022688:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 183 00000001:00080000:3.0:1784045332.022974:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:3.0:1784045332.022989:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1784045332.023017:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1784045332.023025:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1784045332.025414:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1784045332.025431:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1784045332.029364:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829764352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784045332.029452:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045332.029534:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829764352 00000100:00100000:3.0:1784045332.029542:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829764352 00000100:00100000:3.0:1784045332.029683:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784045332.029694:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829764352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784045332.029951:0:8930:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784045332.029955:0:8930:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784045331 00002000:00010000:3.0:1784045332.029957:0:8930:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784045332.029960:0:8930:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784045331 -> 1784045331 00002000:00010000:3.0:1784045332.029962:0:8930:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784045332.030011:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829764352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 319us (558us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784045332.030019:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784045332.030147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.030172:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797696 00000100:00100000:3.0:1784045332.030176:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797696 00000100:00100000:3.0:1784045332.030202:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:3.0:1784045332.030209:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:2360:x1870706808797696:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1784045332.030704:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa93b5a8380/2, rc 0, transno 4294967315 00000100:00100000:3.0:1784045332.030713:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93b5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829764352:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1784045332.096209:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1784045332.096233:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1784045332.098852:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808797696:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 68613us (68676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045332.098871:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:3.0:1784045332.101337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.101377:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808797952 00000100:00100000:3.0:1784045332.101386:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808797952 00000100:00100000:3.0:1784045332.101449:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 184 00000100:00100000:3.0:1784045332.101460:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:11489:x1870706808797952:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045332.101513:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045332.101637:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d92a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800002 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.101712:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:3.0:1784045332.101718:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045332.101765:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.101780:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.101790:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045332.103238:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000371d8f9f reply state 00000000cc2e7d9d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.103255:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045332.104109:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11489:x1870706808797952:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 2648us (2777us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1784045332.104120:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 184 00000100:00080000:3.0:1784045332.104152:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1784045332.110465:0:12325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045332.110477:0:12325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1784045332.110883:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.110895:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.110902:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.110908:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045332.110913:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.110920:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.110946:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:3.0:1784045332.110950:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045332.110955:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.110961:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d93f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045332.111192:0:12325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784045332.111199:0:12325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045332.114763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045332.119491:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808798080 00000100:00100000:2.0:1784045332.119510:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808798080 00000100:00100000:3.0:1784045332.123923:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:3.0:1784045332.123946:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808798080:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784045332.124195:0:8930:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784045332.124199:0:8930:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784045331 -> 1784045330 00002000:00010000:3.0:1784045332.124202:0:8930:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784045329 00002000:00010000:3.0:1784045332.124204:0:8930:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784045331 -> 1784045330 00002000:00010000:3.0:1784045332.124207:0:8930:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784045332.124272:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808798080:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 338us (9520us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1784045332.124281:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:2.0:1784045332.129433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.129620:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808798336 00000100:00100000:3.0:1784045332.129631:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808798336 00000100:00100000:3.0:1784045332.129688:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 185 00000100:00100000:3.0:1784045332.129698:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:11489:x1870706808798336:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784045332.129776:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.129794:0:7507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.129803:0:7507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.129893:0:7507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.129923:0:7507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 18 pid: 5806 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.130517:0:7507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829764480:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045332.133548:0:7507:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bc780 going to sleep for 11 seconds 00000100:00100000:1.0:1784045332.142414:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045332.142455:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808798464 00000100:00100000:1.0:1784045332.142466:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808798464 00010000:00010000:1.0:1784045332.142513:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 19 pid: 5806 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045332.142556:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784045332.142566:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:2361:x1870706808798464:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045332.142581:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045332.142588:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 19 pid: 5806 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.142601:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 19 pid: 5806 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.142624:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:1.0:1784045332.142630:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.142648:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.142656:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.142678:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045332.142749:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:2361:x1870706808798464:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 184us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045332.142757:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00010000:00010000:3.0:1784045332.143268:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360e00/0xdb5b5ff6a2d2d90e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffff4 expref: 18 pid: 5806 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.143285:0:7507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7507:1870706829764480:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045332.143319:0:7507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143327:0:7507:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143332:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143360:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143366:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143373:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143378:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045332.143382:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143397:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143408:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:3.0:1784045332.143411:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784045332.143414:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.143419:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d946 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.143464:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:11489:x1870706808798336:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 13768us (14040us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784045332.143473:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 185 00000100:00100000:1.0:1784045332.160381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.160503:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808798592 00000100:00100000:3.0:1784045332.160514:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808798592 00000100:00100000:3.0:1784045332.160585:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1784045332.160594:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808798592:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784045332.160639:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.160665:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.160682:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045332.160690:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045332.160694:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.160751:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.160764:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 8 pid: 6599 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.160780:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93facdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829764608:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045332.160881:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bc780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045332.162653:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93facdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829764608:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045332.162682:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045332.164422:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.164673:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808798720 00000100:00100000:3.0:1784045332.164684:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808798720 00010000:00010000:3.0:1784045332.164729:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 9 pid: 6599 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.164783:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:3.0:1784045332.164795:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808798720:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045332.164812:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045332.164870:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 9 pid: 6599 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.164885:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 9 pid: 6599 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.164907:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd185667/0xdb5b5ff6a2d2d938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800010 expref: 9 pid: 6599 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.165171:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045332.165177:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045332.165183:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.165194:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.165235:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045332.165364:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165375:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165400:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165408:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165428:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165436:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045332.165440:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165449:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165463:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.165471:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2d94d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045332.165544:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808798592:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 4950us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.165554:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1784045332.166126:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808798720:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1330us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045332.166134:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1784045332.178071:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045332.178119:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808798976 00000100:00100000:1.0:1784045332.178127:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808798976 00000100:00100000:1.0:1784045332.178180:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:1.0:1784045332.178191:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+17:11489:x1870706808798976:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784045332.178285:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178304:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178318:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178518:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178541:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 18 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178549:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178585:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 18 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.178599:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 18 pid: 7507 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045332.178614:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829764736:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045332.178688:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910d8dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045332.182238:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d056d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829764736:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045332.182271:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045332.182439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045332.183106:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808799104 00000100:00100000:0.0:1784045332.183116:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808799104 00010000:00010000:0.0:1784045332.183157:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 19 pid: 7507 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045332.183197:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:0.0:1784045332.183329:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:2360:x1870706808799104:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045332.183345:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045332.183353:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 19 pid: 7507 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.183365:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 19 pid: 7507 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.183388:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d91c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217ffffb expref: 19 pid: 7507 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.183402:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:0.0:1784045332.183407:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.183417:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.183425:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045332.183451:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045332.184070:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.184079:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045332.184270:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1784045332.184412:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1784045332.184458:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1784045332.184540:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1870706829764864:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784045332.184598:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045332.184639:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e300 going to sleep for 11 seconds 00000100:00100000:1.0:1784045332.185094:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829764864 00000100:00100000:1.0:1784045332.185102:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829764864 00000100:00100000:1.0:1784045332.185157:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045332.185167:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1870706829764864:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784045332.185328:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1870706829764864:12345-0@lo:1000:mdt00_001.0 Request processed in 162us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045332.185336:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045332.186069:0:5805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1784045332.186077:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa93b5a8380, transno 4294967315 00000100:00100000:2.0:1784045332.186099:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1870706829764864:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1784045332.186615:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1784045332.186687:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1870706829764992:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784045332.186748:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045332.186784:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e480 going to sleep for 11 seconds 00000100:00100000:2.0:1784045332.186807:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829764992 00000100:00100000:2.0:1784045332.186812:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829764992 00000100:00100000:2.0:1784045332.186871:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045332.186879:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1870706829764992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784045332.187289:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1870706829764992:12345-0@lo:1000:mdt00_001.0 Request processed in 408us (550us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784045332.187296:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045332.187338:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1870706829764992:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1784045332.187371:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187381:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187388:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187395:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045332.187399:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187406:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187423:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa91040d600) 00010000:00010000:2.0:1784045332.187426:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045332.187431:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187439:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2d95b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187479:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187486:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187492:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187497:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045332.187500:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187506:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187514:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:2.0:1784045332.187517:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045332.187520:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187526:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d897 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187546:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187560:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 22 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187569:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187603:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 22 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045332.187618:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 22 pid: 12196 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045332.187632:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829765120:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045332.188095:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2360:x1870706808799104:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 4765us (5654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.188106:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:2.0:1784045332.194970:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045332.200436:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.200510:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808799232 00000100:00100000:3.0:1784045332.200520:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808799232 00010000:00010000:3.0:1784045332.200633:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 22 pid: 12196 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045332.200679:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1784045332.200689:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2361:x1870706808799232:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045332.200705:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045332.200712:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 22 pid: 12196 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.200725:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 22 pid: 12196 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.200773:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:3.0:1784045332.200778:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.200789:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.200796:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.200816:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045332.200896:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2361:x1870706808799232:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 208us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045332.200904:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00010000:00010000:2.0:1784045332.203094:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2d8b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055217fffdf expref: 21 pid: 12196 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045332.203119:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829765120:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045332.203144:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203214:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203222:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203242:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203250:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203257:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203264:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045332.203268:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203275:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203289:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045332.203293:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045332.203297:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203303:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2d962 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203314:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203320:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203326:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203336:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045332.203340:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203346:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203355:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045332.203358:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784045332.203361:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.203366:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2d954 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045332.203655:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:11489:x1870706808798976:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 25464us (25597us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1784045332.203666:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 186 00000020:00080000:1.0:1784045332.203671:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784045332.206808:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045332.206819:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045332.210086:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1784045332.210102:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045332.210314:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045332.211122:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808799488 00000100:00100000:3.0:1784045332.211137:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808799488 00000100:00100000:3.0:1784045332.211193:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1784045332.211203:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:11489:x1870706808799488:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784045332.212148:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784045332.212268:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1784045332.212316:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.212333:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.212353:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.212362:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.212369:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.212375:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045332.212402:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784045332.212493:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:11489:x1870706808799488:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1290us (2181us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1784045332.212502:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000020:00080000:3.0:1784045332.212507:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784045332.212978:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045332.212986:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.212994:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045332.212999:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.213008:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.213033:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:1.0:1784045332.213036:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784045332.213042:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.213048:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d969 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045332.213067:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045332.213069:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045332.213071:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045332.705008:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045333.407986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045333.408029:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045333.408069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045333.408090:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045333.408116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045333.408165:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808800000 00000100:00100000:2.0:1784045333.408177:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808800000 00000100:00100000:2.0:1784045333.408244:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808799872 00000100:00100000:2.0:1784045333.408247:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808799872 00000100:00100000:2.0:1784045333.408273:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:2.0:1784045333.408285:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808800000:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045333.408385:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808800000:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045333.408393:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:2.0:1784045333.408412:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:2.0:1784045333.408418:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2362:x1870706808799872:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045333.408440:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2362:x1870706808799872:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045333.408446:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:2.0:1784045333.408464:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808799616 00000100:00100000:2.0:1784045333.408467:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808799616 00000100:00100000:2.0:1784045333.408488:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 298 00000100:00100000:2.0:1784045333.408493:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808799616:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045333.408527:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2362:x1870706808799616:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045333.408533:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 298 00000100:00100000:2.0:1784045333.408563:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808799744 00000100:00100000:2.0:1784045333.408566:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808799744 00000100:00100000:2.0:1784045333.408590:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808800128 00000100:00100000:2.0:1784045333.408592:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808800128 00000100:00100000:2.0:1784045333.408610:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:2.0:1784045333.408616:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2362:x1870706808799744:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045333.408771:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2362:x1870706808799744:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 154us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045333.408778:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:2.0:1784045333.408791:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:2.0:1784045333.408806:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808800128:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045333.408863:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2362:x1870706808800128:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 57us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045333.408870:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00080000:2.0:1784045333.408888:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045333.408894:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045333.408896:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784045333.730394:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045334.254584:0:12376:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045334.254592:0:12376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045334.254628:0:12376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784045334.254633:0:12376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045334.435189:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045334.435266:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808800384 00000100:00100000:2.0:1784045334.435277:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808800384 00000100:00100000:2.0:1784045334.435355:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:2.0:1784045334.435367:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:11507:x1870706808800384:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045334.435387:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045334.435409:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800017 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.435667:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d977 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.435684:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d977 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.435709:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d977 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045334.435722:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1784045334.435907:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800017 expref: 25 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.435926:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d977 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800017 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.435941:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045334.435945:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045334.435949:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721c00, rc 0) 00000100:00100000:2.0:1784045334.436002:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11507:x1870706808800384:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 638us (825us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1784045334.436008:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00080000:3.0:1784045334.436264:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045334.438950:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.439039:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808800512 00000100:00100000:3.0:1784045334.439048:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808800512 00000100:00100000:3.0:1784045334.439109:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:3.0:1784045334.439119:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11507:x1870706808800512:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784045334.439197:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439214:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439245:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439264:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439272:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439278:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439575:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439584:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439591:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045334.439627:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439639:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439645:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439652:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439667:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.439672:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439679:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439691:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045334.439693:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045334.439713:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439720:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2d985 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439733:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439738:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439744:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439749:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.439751:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439757:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439773:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa92210cb00) 00010000:00010000:3.0:1784045334.439775:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045334.439778:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439783:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2d98c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439798:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439803:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439809:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439813:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.439816:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439822:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439855:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa92210c600) 00010000:00010000:3.0:1784045334.439858:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045334.439861:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.439866:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2d993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045334.439947:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11507:x1870706808800512:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 827us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045334.439956:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:3.0:1784045334.521286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045334.521377:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808800768 00000100:00100000:0.0:1784045334.521387:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808800768 00000100:00100000:0.0:1784045334.521455:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:0.0:1784045334.521477:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+24:11510:x1870706808800768:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045334.521498:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045334.521519:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d99a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180001e expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521592:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521607:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521619:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521633:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521640:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521646:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521973:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521981:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.521988:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045334.522007:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1784045334.522099:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522106:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522113:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522119:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045334.522124:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522132:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522144:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045334.522147:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045334.522150:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522156:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2d9a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522167:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522172:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522187:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522192:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045334.522195:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522201:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522207:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa9118c5500) 00010000:00010000:0.0:1784045334.522209:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045334.522212:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522217:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2d9a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522256:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2d99a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 27 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522269:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 26 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045334.522276:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:0.0:1784045334.522278:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045334.522280:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32c00, rc 0) 00000100:00100000:0.0:1784045334.522341:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11510:x1870706808800768:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 866us (1062us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1784045334.522357:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:0.0:1784045334.530435:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045334.530507:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808800896 00000100:00100000:2.0:1784045334.530519:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808800896 00000100:00100000:2.0:1784045334.530578:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:2.0:1784045334.530588:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11510:x1870706808800896:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784045334.530652:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530667:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530677:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530714:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530720:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530726:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530741:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045334.530744:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530749:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530758:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:2.0:1784045334.530760:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045334.530763:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.530767:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045334.530868:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11510:x1870706808800896:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 282us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045334.530873:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:0.0:1784045334.540089:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.541412:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808801152 00000100:00100000:3.0:1784045334.541424:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808801152 00000100:00100000:3.0:1784045334.541494:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1784045334.541505:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11510:x1870706808801152:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784045334.541737:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:11510:x1870706808801152:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 233us (1656us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1784045334.541744:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1784045334.609612:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045334.609676:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808801408 00000100:00100000:2.0:1784045334.609686:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808801408 00000100:00100000:2.0:1784045334.609758:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:2.0:1784045334.609768:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:11037:x1870706808801408:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045334.609804:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045334.609854:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800025 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.609968:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.610000:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 28 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.610009:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.610045:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 28 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.610058:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 28 pid: 12196 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045334.610071:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829765248:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045334.610159:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045334.616423:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939c5d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1870706829765248:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045334.616453:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045334.618942:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045334.619212:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808801536 00000100:00100000:1.0:1784045334.619224:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808801536 00010000:00010000:1.0:1784045334.619265:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 29 pid: 12196 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045334.619314:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:1.0:1784045334.619325:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:2360:x1870706808801536:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045334.619341:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045334.619347:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 29 pid: 12196 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045334.619361:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 29 pid: 12196 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045334.619401:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2d9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180001e expref: 29 pid: 12196 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045334.619417:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:1.0:1784045334.619423:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045334.619432:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045334.619441:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045334.619474:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045334.619530:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:2360:x1870706808801536:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 206us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045334.619538:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00010000:00010000:2.0:1784045334.619740:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.619749:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045334.619768:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784045334.619956:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 29 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.619987:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.619996:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:2.0:1784045334.619998:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045334.620001:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721e00, rc 0) 00000100:00100000:2.0:1784045334.620041:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11037:x1870706808801408:12345-192.168.201.58@tcp:101:bash.0 Request processed in 10274us (10439us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1784045334.620048:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:2.0:1784045334.627591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.627631:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808801792 00000100:00100000:3.0:1784045334.627640:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808801792 00000100:00100000:3.0:1784045334.627714:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:3.0:1784045334.627724:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11037:x1870706808801792:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:3.0:1784045334.628015:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.628033:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.628044:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045334.628095:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1784045334.628134:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d395cc7c reply state 000000000d47fa45 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045334.628144:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784045334.628191:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1784045334.628438:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11037:x1870706808801792:12345-192.168.201.58@tcp:36:bash.0 Request processed in 714us (856us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1784045334.628446:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 192 00000020:00080000:3.0:1784045334.628450:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1784045334.633439:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.633457:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.633465:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.633471:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.633476:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.633483:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045334.633488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1784045334.633505:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:3.0:1784045334.633508:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045334.633513:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.633518:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2d9d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045334.633585:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808801920 00000100:00100000:2.0:1784045334.633594:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808801920 00000100:00100000:2.0:1784045334.633645:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:2.0:1784045334.633653:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:11037:x1870706808801920:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045334.633672:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045334.633685:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180002c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.633755:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180002c expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.633770:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180002c expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.633994:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:2.0:1784045334.634003:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045334.634006:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720600, rc 0) 00000100:00100000:2.0:1784045334.634106:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11037:x1870706808801920:12345-192.168.201.58@tcp:101:bash.0 Request processed in 451us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045334.634113:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:0.0:1784045334.641250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045334.641332:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808802048 00000100:00100000:2.0:1784045334.641342:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808802048 00000100:00100000:2.0:1784045334.641406:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:2.0:1784045334.641415:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:11037:x1870706808802048:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045334.641435:0:8930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045334.641455:0:8930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800033 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045334.641480:0:8930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a565f12, atime: 0x6a565f11, ctime: 0x6a565f12, blocks: 0xb 00010000:00010000:2.0:1784045334.641509:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1784045334.641514:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045334.641522:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 8 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.641539:0:8930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 8 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.641551:0:8930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721600, rc 0) 00000100:00100000:2.0:1784045334.641655:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:11037:x1870706808802048:12345-192.168.201.58@tcp:101:bash.0 Request processed in 240us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045334.641661:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:3.0:1784045334.661064:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045334.661247:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808802176 00000100:00100000:1.0:1784045334.661258:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808802176 00002000:00010000:1.0:1784045334.661312:0:6604:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1784045334.661318:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa937740000 with x1870706808802176 ext(0->18446744073709551615) 00002000:00010000:1.0:1784045334.661333:0:6604:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa937740000. 00000100:00100000:1.0:1784045334.661372:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784045334.661381:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2363:x1870706808802176:12345-192.168.201.58@tcp:10:bash.0 00002000:00010000:1.0:1784045334.661634:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1784045334.661638:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784045330 -> 1784045334 00002000:00010000:1.0:1784045334.661640:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1784045329 -> 1784045329 00002000:00010000:1.0:1784045334.661655:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784045330 -> 1784045334 00002000:00010000:1.0:1784045334.661657:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1784045334.661729:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2363:x1870706808802176:12345-192.168.201.58@tcp:10:bash.0 Request processed in 348us (676us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1784045334.661737:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00002000:00010000:1.0:1784045334.661740:0:6604:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1784045334.661743:0:6604:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa937740000 with x1870706808802176 ext(0->18446744073709551615) 00002000:00010000:1.0:1784045334.661748:0:6604:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa937740000. 00000100:00100000:0.0:1784045334.740165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045334.740287:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808802304 00000100:00100000:2.0:1784045334.740299:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808802304 00000100:00100000:2.0:1784045334.740371:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 194 00000100:00100000:2.0:1784045334.740381:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11524:x1870706808802304:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:2.0:1784045334.740460:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.740477:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.740502:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.740520:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.740527:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.740533:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741469:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741540:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741552:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045334.741603:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741627:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741633:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741640:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741646:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045334.741651:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741660:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741675:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045334.741679:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045334.741684:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741702:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2d9ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741717:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741723:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741729:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741740:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045334.741743:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741750:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741758:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0600) 00010000:00010000:2.0:1784045334.741760:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045334.741763:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.741768:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2d9f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742550:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742563:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742569:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742574:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045334.742577:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742584:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742608:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:2.0:1784045334.742611:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045334.742615:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.742621:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2d9fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045334.742884:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11524:x1870706808802304:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 2499us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045334.742894:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 194 00010000:00010000:0.0:1784045334.753018:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045334.789740:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.789947:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808802560 00000100:00100000:3.0:1784045334.789957:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808802560 00000100:00100000:3.0:1784045334.790020:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:3.0:1784045334.790031:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+32:11527:x1870706808802560:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045334.790052:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045334.790074:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2da03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180003a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790150:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790165:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790176:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790190:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790198:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790217:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790969:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2da18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.790992:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2da18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791000:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2da18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045334.791010:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784045334.791096:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791104:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791111:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791117:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.791121:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791128:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791140:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045334.791142:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045334.791146:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791152:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2da0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791163:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791174:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791179:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791184:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.791187:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791193:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791427:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa92210c600) 00010000:00010000:3.0:1784045334.791431:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045334.791435:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791442:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791702:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2da03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180003a expref: 35 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791720:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2da18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180003a expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.791728:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:3.0:1784045334.791730:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784045334.791740:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045e00, rc 0) 00000100:00100000:3.0:1784045334.791933:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11527:x1870706808802560:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1902us (2202us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1784045334.791942:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:0.0:1784045334.796567:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.796754:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808802688 00000100:00100000:3.0:1784045334.796765:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808802688 00000100:00100000:3.0:1784045334.796881:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1784045334.796893:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11527:x1870706808802688:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784045334.796972:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.796990:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.797000:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.797035:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.797047:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 34 pid: 5806 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045334.797061:0:12196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1870706829765376:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045334.797138:0:12196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045334.800665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.800809:0:12196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941a1d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1870706829765376:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045334.800879:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045334.801861:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808802944 00000100:00100000:1.0:1784045334.801871:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808802944 00000100:00100000:1.0:1784045334.801976:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:1.0:1784045334.801985:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:5577:x1870706808802944:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784045334.802372:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:5577:x1870706808802944:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 387us (1718us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1784045334.802380:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:2.0:1784045334.805158:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045334.805590:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808803072 00000100:00100000:3.0:1784045334.805601:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808803072 00010000:00010000:3.0:1784045334.805645:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 36 pid: 5806 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045334.805687:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:3.0:1784045334.805706:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:2361:x1870706808803072:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045334.805721:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045334.805728:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 36 pid: 5806 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.805741:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 36 pid: 5806 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.805767:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2d9cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800025 expref: 36 pid: 5806 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.805797:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:3.0:1784045334.805802:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.805812:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.805819:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.805888:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045334.805959:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:2361:x1870706808803072:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 254us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045334.805969:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00010000:00010000:3.0:1784045334.806028:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806036:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806070:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806077:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806083:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806090:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045334.806094:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806102:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806111:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:3.0:1784045334.806113:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045334.806117:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045334.806123:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2da26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045334.806174:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11527:x1870706808802688:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 9283us (9615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045334.806182:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1784045334.809792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045334.809915:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808803328 00000100:00100000:0.0:1784045334.809925:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808803328 00000100:00100000:0.0:1784045334.809979:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:0.0:1784045334.809989:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+34:11527:x1870706808803328:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045334.810440:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11527:x1870706808803328:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 450us (670us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1784045334.810449:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1784045334.945686:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829765504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045334.945792:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045334.946143:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829765504 00000100:00100000:3.0:1784045334.946152:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829765504 00000100:00100000:3.0:1784045334.946220:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784045334.946231:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829765504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045334.946264:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045334.946321:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829765504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045334.946329:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1784045334.946444:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045334.946534:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829765504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045334.959180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045334.962974:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808803584 00000100:00100000:2.0:1784045334.962989:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808803584 00000100:00100000:2.0:1784045334.963073:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:2.0:1784045334.963085:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+35:11538:x1870706808803584:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:2.0:1784045334.963112:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045334.963134:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800041 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.963223:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.963245:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.963258:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.963894:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.963904:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.963913:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.964911:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2da42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.964925:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2da42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.964934:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2da42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045334.964946:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1784045334.965039:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965047:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965054:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965060:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045334.965064:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965084:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965098:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045334.965100:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045334.965105:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965110:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965123:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965129:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965135:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965140:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045334.965143:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965149:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965156:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0600) 00010000:00010000:2.0:1784045334.965159:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045334.965162:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965176:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965245:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800041 expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965261:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2da42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800041 expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045334.965277:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:2.0:1784045334.965280:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045334.965980:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720800, rc 0) 00000100:00100000:2.0:1784045334.966074:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11538:x1870706808803584:12345-192.168.201.58@tcp:101:cat.0 Request processed in 2988us (6898us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1784045334.966086:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:2.0:1784045334.987298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045334.987435:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808803840 00000100:00100000:0.0:1784045334.987445:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808803840 00000100:00100000:0.0:1784045334.987525:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:0.0:1784045334.987535:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11538:x1870706808803840:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1784045334.987798:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11538:x1870706808803840:12345-192.168.201.58@tcp:35:cat.0 Request processed in 263us (519us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1784045334.987805:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:3.0:1784045335.021233:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.021428:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808804096 00000100:00100000:2.0:1784045335.021439:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808804096 00000100:00100000:2.0:1784045335.021519:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 198 00000100:00100000:2.0:1784045335.021530:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11539:x1870706808804096:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:2.0:1784045335.021590:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784045335.021617:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2da42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800041 expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021638:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2da18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180003a expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021675:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2d9e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180002c expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021694:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa9118c5d00) 00010000:00010000:2.0:1784045335.021706:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045335.021727:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021741:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021751:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021765:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021782:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.021789:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.022639:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.022652:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.022662:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045335.023729:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1784045335.023742:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369709911485ns, next at 370709909123ns, rc = 0 00010000:00010000:2.0:1784045335.024419:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024438:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024449:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024457:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024642:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024648:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024671:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045335.024701:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024708:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024714:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024719:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.024733:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024740:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024753:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa902ec0700) 00010000:00010000:2.0:1784045335.024756:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784045335.024761:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024769:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2da5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024800:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024807:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024812:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024818:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.024821:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024827:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024854:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045335.024857:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045335.024865:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.024871:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2da50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045335.024883:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de9aa30c reply state 00000000d1f84413 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.024892:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045335.024978:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+37:11539:x1870706808804096:12345-192.168.201.58@tcp:36:rm.0 Request processed in 3446us (3751us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784045335.024987:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 198 00010000:00010000:3.0:1784045335.026739:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045335.026752:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.026763:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045335.026779:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.026789:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.026805:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8aa902ec0700) 00010000:00010000:3.0:1784045335.026808:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784045335.026826:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.026866:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2da65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.026888:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045335.026890:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045335.026891:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045335.027183:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.027192:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.027198:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.027218:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045335.027222:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.027228:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.027421:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0600) 00010000:00010000:3.0:1784045335.027423:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045335.027427:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.027432:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2da57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.111729:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045335.111974:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808804352 00000100:00100000:0.0:1784045335.111999:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808804352 00000100:00100000:0.0:1784045335.112064:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:0.0:1784045335.112076:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+36:11545:x1870706808804352:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045335.112101:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045335.112123:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2da6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800048 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.112251:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.112265:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.112276:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.112290:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.112296:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.112302:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045335.112908:0:12196:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1784045335.113057:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113068:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113089:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113129:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113135:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113142:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113148:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045335.113152:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113159:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113171:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045335.113173:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045335.113178:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113183:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2da73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045335.113196:0:12196:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007dd50bc8 reply state 00000000755022fd transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045335.113205:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784045335.113238:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2da6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 39 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113251:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 38 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.113258:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:0.0:1784045335.113260:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045335.113262:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33600, rc 0) 00000100:00100000:0.0:1784045335.113329:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11545:x1870706808804352:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1256us (1610us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1784045335.113338:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 199 00010000:00010000:3.0:1784045335.120526:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.120548:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.120556:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.120562:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045335.120566:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.120574:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.120591:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa9118c5500) 00010000:00010000:3.0:1784045335.120594:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045335.120599:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.120605:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2da7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045335.120915:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.121442:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808804480 00000100:00100000:3.0:1784045335.121455:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808804480 00000100:00100000:3.0:1784045335.121556:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:3.0:1784045335.121568:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2363:x1870706808804480:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784045335.121602:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045335.121620:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180004f expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045335.121649:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784045335.121670:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1784045335.121675:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045335.121696:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.121717:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 6 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.121731:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044000, rc 0) 00000100:00100000:3.0:1784045335.121802:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2363:x1870706808804480:12345-192.168.201.58@tcp:101:bash.0 Request processed in 238us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045335.121810:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00080000:0.0:1784045335.122923:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045335.125494:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.125620:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808804608 00000100:00100000:2.0:1784045335.125632:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808804608 00000100:00100000:2.0:1784045335.125703:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:2.0:1784045335.125713:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:11545:x1870706808804608:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045335.125732:0:8930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045335.125749:0:8930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800056 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.125789:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.125798:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045335.125803:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045335.125807:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.125899:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.125915:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.125931:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8930:1870706829765632:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045335.126023:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045335.130259:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8930:1870706829765632:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045335.130311:0:8930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 7 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.130332:0:8930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045335.130432:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:11545:x1870706808804608:12345-192.168.201.58@tcp:101:bash.0 Request processed in 4719us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045335.130443:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:0.0:1784045335.132184:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045335.135409:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808804736 00000100:00100000:1.0:1784045335.135426:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808804736 00010000:00010000:1.0:1784045335.135539:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.135595:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:1.0:1784045335.135606:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808804736:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045335.135638:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045335.135661:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.135675:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.135709:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001eb7ddf1/0xdb5b5ff6a2d2da8f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180004f expref: 7 pid: 6598 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.135730:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045335.135735:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045335.135744:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.135754:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.135935:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.135949:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d054700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5791:1870706829765760:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784045335.136065:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045335.145708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045335.146212:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d054700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5791:1870706829765760:192.168.201.58@tcp:105: 00000100:00100000:3.0:1784045335.146577:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808804992 00000100:00100000:3.0:1784045335.146584:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808804992 00000100:00100000:3.0:1784045335.146646:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:3.0:1784045335.146655:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+38:11545:x1870706808804992:12345-192.168.201.58@tcp:35:bash.0 00010000:00010000:1.0:1784045335.146852:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045335.146973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2360:x1870706808804736:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 11369us (14797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.146982:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1784045335.147355:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11545:x1870706808804992:12345-192.168.201.58@tcp:35:bash.0 Request processed in 699us (1654us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1784045335.147363:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1784045335.388355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045335.388479:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808805120 00000100:00100000:1.0:1784045335.388489:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808805120 00000100:00100000:1.0:1784045335.388558:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:1.0:1784045335.388578:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+39:11561:x1870706808805120:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045335.388604:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045335.388641:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2da9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180005d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.388732:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2daa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.388748:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2daa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.388762:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2daa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045335.388874:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1784045335.388878:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045335.388904:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2daa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.388928:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2da9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180005d expref: 41 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.388946:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2daa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180005d expref: 40 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.388973:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:1.0:1784045335.388975:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045335.388979:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360200, rc 0) 00000100:00100000:1.0:1784045335.389044:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11561:x1870706808805120:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 477us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.389051:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:0.0:1784045335.401621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.401825:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808805376 00000100:00100000:2.0:1784045335.401853:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808805376 00000100:00100000:2.0:1784045335.401949:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:2.0:1784045335.401960:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+40:11561:x1870706808805376:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045335.401982:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045335.402003:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800064 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.402125:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.402139:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.402151:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045335.402162:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784045335.402292:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800064 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.402310:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800064 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.402318:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:2.0:1784045335.402321:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045335.402325:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720800, rc 0) 00000100:00100000:2.0:1784045335.402514:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:11561:x1870706808805376:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 556us (904us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784045335.402522:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:0.0:1784045335.406997:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.407091:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808805504 00000100:00100000:3.0:1784045335.407110:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808805504 00000100:00100000:3.0:1784045335.407192:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:3.0:1784045335.407200:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+42:2360:x1870706808805504:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045335.407214:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045335.407236:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800064 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.407251:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045335.407255:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045335.407302:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:2360:x1870706808805504:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045335.407308:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784045335.409561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.409636:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808805760 00000100:00100000:2.0:1784045335.409643:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808805760 00000100:00100000:3.0:1784045335.409726:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:3.0:1784045335.409851:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+41:11561:x1870706808805760:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045335.409877:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045335.409896:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180006b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.409980:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2dac7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.409993:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2dac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.410004:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2dac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045335.410016:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784045335.410131:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180006b expref: 44 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.410145:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2dac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180006b expref: 43 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.410151:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045335.410153:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045335.410156:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044000, rc 0) 00000100:00100000:3.0:1784045335.410243:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11561:x1870706808805760:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 416us (688us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1784045335.410248:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:1.0:1784045335.418129:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.420868:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808805888 00000100:00100000:3.0:1784045335.420884:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808805888 00000100:00100000:3.0:1784045335.421026:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:3.0:1784045335.421038:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+6:2361:x1870706808805888:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:3.0:1784045335.421087:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.421110:0:6598:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.421119:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1784045335.421123:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045335.421128:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.421163:0:6598:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 6 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.421191:0:6598:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 6 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.421207:0:6598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1870706829765888:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045335.421305:0:6598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045335.423980:0:6598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6598:1870706829765888:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784045335.424014:0:6598:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.425316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.426664:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808806016 00000100:00100000:2.0:1784045335.426676:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808806016 00002000:00100000:2.0:1784045335.426847:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8aa92d056300 x1870706808806016/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:731/0 lens 504/0 e 0 to 0 dl 1784045346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045335.426880:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa92d056300 with x1870706808806016 ext(0->8) 00010000:00010000:2.0:1784045335.426891:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 7 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.426910:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 7 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045335.426919:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa92d056300 00000100:00100000:2.0:1784045335.427028:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1784045335.427038:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808806016:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:2.0:1784045335.427562:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2361:x1870706808806016:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 522us (2250us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784045335.427570:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00002000:00100000:2.0:1784045335.427578:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8aa92d056300 x1870706808806016/t4294967308(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:731/0 lens 504/448 e 0 to 0 dl 1784045346 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045335.427586:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa92d056300 with x1870706808806016 ext(0->8) 00010000:00010000:2.0:1784045335.427592:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 9 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.427604:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 9 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045335.427612:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8aa92d056300 00000100:00100000:0.0:1784045335.433858:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.433978:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808806144 00000100:00100000:2.0:1784045335.434002:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808806144 00010000:00010000:2.0:1784045335.434047:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 9 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.434087:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:2.0:1784045335.434095:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808806144:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045335.434108:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784045335.434124:0:7496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784045335.434126:0:7496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784045335 00002000:00010000:2.0:1784045335.434128:0:7496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784045335 00002000:00010000:2.0:1784045335.434129:0:7496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784045335 00010000:00010000:2.0:1784045335.434134:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 9 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.434144:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 9 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.434163:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5697c9a/0xdb5b5ff6a2d2da96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda05521800056 expref: 9 pid: 8930 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.434178:0:7496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045335.434182:0:7496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045335.434187:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.434194:0:7496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.434231:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045335.434276:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808806144:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 181us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045335.434284:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00010000:00010000:1.0:1784045335.434486:0:6598:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434497:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434523:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434532:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434540:0:6598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434546:0:6598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045335.434558:0:6598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434568:0:6598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434581:0:6598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.434587:0:6598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88764ea/0xdb5b5ff6a2d2dad5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.434636:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808805888:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 13601us (16516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.434645:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1784045335.442520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.442674:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808806400 00000100:00100000:3.0:1784045335.442694:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808806400 00000100:00100000:3.0:1784045335.442905:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:3.0:1784045335.442916:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11561:x1870706808806400:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:3.0:1784045335.442989:0:5808:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2dac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180006b expref: 43 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045335.443222:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1784045335.443258:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1784045335.443549:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1784045335.443595:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.443610:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 47 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.443638:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.443670:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 47 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.443697:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 47 pid: 12196 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.443711:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1870706829766016:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045335.444857:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045335.451524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045335.451628:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808806528 00000100:00100000:1.0:1784045335.451637:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808806528 00010000:00010000:1.0:1784045335.451690:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 48 pid: 12196 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.451906:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:1.0:1784045335.451920:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+48:2360:x1870706808806528:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045335.451938:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784045335.451942:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1870706829766016:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045335.451950:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 48 pid: 12196 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.451967:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 48 pid: 12196 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.458451:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.458471:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2da81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800048 expref: 48 pid: 12196 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.458496:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:1.0:1784045335.458501:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.458511:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.458519:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.458546:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045335.458620:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+47:2360:x1870706808806528:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 6702us (7103us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.458630:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00010000:00010000:2.0:1784045335.468388:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.468407:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045335.468543:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1784045335.468786:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1784045335.468950:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829766144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784045335.469030:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045335.469068:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045335.469270:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829766144 00000100:00100000:0.0:1784045335.469278:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829766144 00000100:00100000:0.0:1784045335.469336:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045335.469345:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829766144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784045335.469432:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829766144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045335.469451:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045335.469488:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829766144:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1784045335.469605:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1784045335.469983:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1784045335.470175:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829766272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784045335.470214:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045335.470241:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045335.470301:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829766272 00000100:00100000:0.0:1784045335.470305:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829766272 00000100:00100000:0.0:1784045335.470333:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045335.470341:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1870706829766272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784045335.470557:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1870706829766272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 217us (341us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784045335.470562:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784045335.470630:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1870706829766272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784045335.470667:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1784045335.470712:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.470816:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.470823:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.470964:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045335.470969:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.470978:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.470994:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:3.0:1784045335.470997:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784045335.471002:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.471009:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dadc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045335.471339:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784045335.471445:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1784045335.471454:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370157622902ns, next at 371157621216ns, rc = 0 00000001:00080000:2.0:1784045335.471460:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1784045335.471566:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa9118c5600) 00010000:00010000:2.0:1784045335.471569:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784045335.471576:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044000/0xdb5b5ff6a2d2dac7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180006b expref: 51 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.471800:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:11561:x1870706808806400:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 28818us (29222us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1784045335.471819:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000020:00080000:2.0:1784045335.471824:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784045335.474207:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045335.474323:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808806656 00000100:00100000:1.0:1784045335.474332:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808806656 00000100:00100000:1.0:1784045335.474461:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:1.0:1784045335.474471:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+50:11561:x1870706808806656:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045335.474495:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045335.474517:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800072 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.474578:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800072 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.474611:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800072 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.474632:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:1.0:1784045335.474635:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045335.474639:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361a00, rc 0) 00000100:00100000:1.0:1784045335.474704:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+51:11561:x1870706808806656:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 234us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.474711:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:0.0:1784045335.479370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.480650:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808806912 00000100:00100000:2.0:1784045335.480662:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808806912 00000100:00100000:2.0:1784045335.480948:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:2.0:1784045335.480961:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+51:11561:x1870706808806912:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045335.481197:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:11561:x1870706808806912:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 239us (1836us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1784045335.481206:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1784045335.602634:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.602797:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808807040 00000100:00100000:2.0:1784045335.602808:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808807040 00000100:00100000:2.0:1784045335.602892:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:2.0:1784045335.602903:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:11571:x1870706808807040:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:2.0:1784045335.602988:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603004:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603015:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603029:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603036:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603042:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603141:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603149:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603155:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045335.603193:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603203:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603210:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603217:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603222:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.603226:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603233:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603242:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045335.603245:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045335.603249:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603260:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2daea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603273:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603279:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603285:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603290:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.603293:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603298:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603304:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0100) 00010000:00010000:2.0:1784045335.603307:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045335.603309:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603315:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2daf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603326:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603332:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603341:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603346:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.603348:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603353:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603360:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045335.603362:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045335.603365:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.603370:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.603451:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:11571:x1870706808807040:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 549us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045335.603459:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:3.0:1784045335.691034:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.691484:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808807296 00000100:00100000:2.0:1784045335.691494:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808807296 00000100:00100000:2.0:1784045335.691559:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:2.0:1784045335.691569:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+52:11574:x1870706808807296:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045335.691589:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045335.691608:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800079 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691712:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691728:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691740:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691755:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691761:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691768:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691926:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2db14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691935:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2db14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.691943:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2db14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045335.691953:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784045335.692050:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692058:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692072:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692078:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.692083:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692091:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692102:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045335.692106:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045335.692110:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692117:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692131:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692136:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692143:0:7507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692148:0:7507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045335.692151:0:7507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692165:0:7507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692173:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0100) 00010000:00010000:2.0:1784045335.692176:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045335.692179:0:7507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692185:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692222:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2daff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800079 expref: 55 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692236:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2db14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800079 expref: 54 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.692258:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045335.692260:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045335.692263:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045335.693071:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:11574:x1870706808807296:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1498us (2041us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1784045335.693082:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:0.0:1784045335.698336:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045335.698554:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808807424 00000100:00100000:1.0:1784045335.698564:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808807424 00000100:00100000:1.0:1784045335.698622:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:1.0:1784045335.698632:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:11574:x1870706808807424:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:1.0:1784045335.698710:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698727:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698738:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698767:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698774:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698798:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698804:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045335.698808:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.698816:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.699566:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:1.0:1784045335.699572:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045335.699578:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.699587:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2db22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.699668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:11574:x1870706808807424:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 1036us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.699688:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:3.0:1784045335.703123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045335.703818:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808807680 00000100:00100000:0.0:1784045335.703827:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808807680 00000100:00100000:0.0:1784045335.704094:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:0.0:1784045335.704106:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+54:11574:x1870706808807680:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045335.704518:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:11574:x1870706808807680:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 414us (1401us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784045335.704528:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00010000:00010000:0.0:1784045335.777014:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045335.825045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.828296:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808807936 00000100:00100000:2.0:1784045335.828316:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808807936 00000100:00100000:2.0:1784045335.828482:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:2.0:1784045335.828495:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+55:11584:x1870706808807936:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045335.828545:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045335.828549:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784045335.828581:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360200/0xdb5b5ff6a2d2daa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180005d expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.828604:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045335.828610:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045335.828626:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2db29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800080 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.828743:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.828757:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.828767:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045335.828779:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784045335.829033:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2db29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800080 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.829053:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800080 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.829062:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045335.829065:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045335.829068:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045335.829149:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:11584:x1870706808807936:12345-192.168.201.58@tcp:101:bash.0 Request processed in 657us (4112us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1784045335.829157:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:1.0:1784045335.833138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.833225:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808808192 00000100:00100000:3.0:1784045335.833235:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808808192 00000100:00100000:3.0:1784045335.833291:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 208 00000100:00100000:3.0:1784045335.833300:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:11584:x1870706808808192:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:3.0:1784045335.833370:0:7507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784045335.833399:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2db30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800080 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.833422:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2db14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800079 expref: 55 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.833434:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045335.833439:0:7507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045335.833622:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.833635:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.833644:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045335.833700:0:7507:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1784045335.833722:0:7507:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b9376a6 reply state 00000000db5ec86b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.833731:0:7507:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045335.833878:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:11584:x1870706808808192:12345-192.168.201.58@tcp:36:bash.0 Request processed in 577us (747us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1784045335.833887:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 208 00000020:00080000:3.0:1784045335.833892:0:7507:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784045335.836522:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1784045335.836594:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.836624:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.836633:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.836640:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942045e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045335.836645:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.836654:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.836682:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045335.836685:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045335.836690:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.836697:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045335.837002:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808808320 00000100:00100000:1.0:1784045335.837012:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808808320 00000100:00100000:1.0:1784045335.837060:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:1.0:1784045335.837071:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+56:11584:x1870706808808320:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784045335.837094:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045335.837113:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2db45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800087 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.837208:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.837222:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.837232:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045335.837262:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784045335.837266:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045335.837285:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.837309:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361600/0xdb5b5ff6a2d2db45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.837325:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045335.837334:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:1.0:1784045335.837337:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045335.837339:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360600, rc 0) 00000100:00100000:1.0:1784045335.837400:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:11584:x1870706808808320:12345-192.168.201.58@tcp:101:bash.0 Request processed in 331us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.837408:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:1.0:1784045335.840339:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.840413:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808808576 00000100:00100000:3.0:1784045335.840423:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808808576 00000100:00100000:3.0:1784045335.840497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:3.0:1784045335.840507:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+57:11584:x1870706808808576:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1784045335.840728:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93b5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+58:11584:x1870706808808576:12345-192.168.201.58@tcp:35:bash.0 Request processed in 221us (398us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1784045335.840736:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1784045335.917651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045335.917755:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808808704 00000100:00100000:3.0:1784045335.917778:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808808704 00000100:00100000:3.0:1784045335.917874:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:3.0:1784045335.917884:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+58:11590:x1870706808808704:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784045335.917909:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045335.917930:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2db53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180008e expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.918010:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.918025:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.918036:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045335.918095:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1784045335.918099:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045335.918121:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.918145:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2db53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180008e expref: 60 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.918164:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180008e expref: 59 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.918172:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045335.918175:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045335.918178:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045e00, rc 0) 00000100:00100000:3.0:1784045335.918236:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:11590:x1870706808808704:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 353us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045335.918243:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:3.0:1784045335.924907:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045335.925114:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808808832 00000100:00100000:0.0:1784045335.925125:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808808832 00000100:00100000:0.0:1784045335.925197:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:0.0:1784045335.925208:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:11590:x1870706808808832:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045335.925240:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045335.925263:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2db61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800095 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925353:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925370:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925381:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925398:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925406:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925413:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925694:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925704:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925712:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045335.925749:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784045335.925753:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045335.925771:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925795:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925804:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925810:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925817:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925823:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045335.925827:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925868:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925880:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045335.925883:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045335.925887:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925893:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925907:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925913:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925925:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925931:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045335.925934:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925941:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.925949:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045335.925951:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045335.925954:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.926026:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33c00/0xdb5b5ff6a2d2db6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.926061:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33200/0xdb5b5ff6a2d2db61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.926076:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.926083:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045335.926086:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045335.926089:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32c00, rc 0) 00000100:00100000:0.0:1784045335.926186:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11590:x1870706808808832:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 979us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045335.926202:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:0.0:1784045335.935656:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045335.935712:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.935801:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809088 00000100:00100000:2.0:1784045335.935811:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809088 00000100:00100000:2.0:1784045335.935896:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:2.0:1784045335.935906:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11590:x1870706808809088:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045335.935926:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045335.935946:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180009c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.936171:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.936188:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.936197:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.936207:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.936313:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.936327:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 61 pid: 5804 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.936361:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829766400:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045335.936558:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809216 00000100:00100000:3.0:1784045335.936563:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809216 00010000:00010000:3.0:1784045335.936589:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 62 pid: 5804 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.936626:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1784045335.936633:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+62:2360:x1870706808809216:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045335.936643:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045335.936649:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 62 pid: 5804 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.937147:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.937159:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 62 pid: 5806 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.937171:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829766528:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045335.937230:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784045335.942946:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 62 pid: 5804 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.943044:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045335.943050:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.943060:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.943067:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045335.943195:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+62:2360:x1870706808809216:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 6560us (7481us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045335.943230:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00010000:00010000:2.0:1784045335.946136:0:5805:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.58@tcp) returned -22 from blocking AST (req@00000000b51cc94e x1870706829766400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 61 pid: 5804 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.946163:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32c00/0xdb5b5ff6a2d2db76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800095 expref: 61 pid: 5804 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045335.946182:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829766400:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045335.949549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.952168:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1870706829766528:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045335.952205:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045335.952213:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.952297:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.952327:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.954013:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809344 00000100:00100000:3.0:1784045335.954025:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809344 00010000:00010000:3.0:1784045335.954069:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 61 pid: 5806 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045335.954129:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784045335.954137:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:2361:x1870706808809344:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045335.954151:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045335.954157:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 61 pid: 5806 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.954170:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 61 pid: 5806 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.954191:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360600/0xdb5b5ff6a2d2db4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800087 expref: 61 pid: 5806 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.954205:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045335.954210:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.954450:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.954460:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045335.954568:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045335.954735:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:2361:x1870706808809344:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 595us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045335.954743:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00010000:00010000:2.0:1784045335.954822:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.954856:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045335.954875:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784045335.955027:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.955045:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.955052:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045335.955055:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045335.955057:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045335.955083:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11590:x1870706808809088:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 19179us (19436us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1784045335.955090:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:2.0:1784045335.971446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045335.971923:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809600 00000100:00100000:0.0:1784045335.971934:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809600 00000100:00100000:0.0:1784045335.972003:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784045335.972015:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11590:x1870706808809600:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:0.0:1784045335.972032:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045335.972057:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800072 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.972076:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045335.972080:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045335.973065:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:11590:x1870706808809600:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 1048us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045335.973075:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784045335.980690:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045335.980763:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809728 00000100:00100000:2.0:1784045335.980773:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809728 00000100:00100000:2.0:1784045335.980880:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:2.0:1784045335.980890:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:11590:x1870706808809728:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:2.0:1784045335.981006:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.981024:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045335.981036:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045335.981224:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1784045335.981301:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93a0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:11590:x1870706808809728:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 411us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045335.981309:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:2.0:1784045335.983309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045335.983420:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809856 00000100:00100000:0.0:1784045335.983431:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809856 00000100:00100000:0.0:1784045335.983489:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:0.0:1784045335.983498:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+59:11590:x1870706808809856:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045335.983516:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045335.983534:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.983589:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.983614:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.983635:0:5804:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.983648:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.983660:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045335.983663:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045335.983667:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045335.983686:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32400, rc 0) 00000100:00100000:0.0:1784045335.983742:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11590:x1870706808809856:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 244us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045335.983749:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 214 00000040:00080000:0.0:1784045336.291960:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045336.291969:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045336.292008:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1784045336.292014:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045336.292135:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa941d0f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829766656:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784045336.292227:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045336.308908:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa941d0f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829766656:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045336.311904:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.311980:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808809984 00000100:00100000:2.0:1784045336.311991:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808809984 00000100:00100000:2.0:1784045336.312068:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:2.0:1784045336.312080:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11591:x1870706808809984:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045336.312112:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045336.312215:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11591:x1870706808809984:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 136us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.312222:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00080000:0.0:1784045336.312297:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045336.322415:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045336.322705:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808810112 00000100:00100000:0.0:1784045336.322715:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808810112 00000100:00100000:0.0:1784045336.322773:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:0.0:1784045336.322784:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11591:x1870706808810112:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784045336.322897:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322914:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322927:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322941:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322948:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322954:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322976:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322985:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.322991:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045336.323035:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784045336.323055:0:12196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045336.323068:0:12196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323080:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323086:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323093:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323098:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045336.323102:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323109:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323122:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:0.0:1784045336.323125:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045336.323129:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323135:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32800/0xdb5b5ff6a2d2dba0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323148:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323154:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323171:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323176:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045336.323179:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323186:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.323207:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045336.324065:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045336.324071:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.324079:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dba7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.324102:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.324109:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.324116:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.324122:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045336.324125:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.325331:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.325348:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045336.325351:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045336.325356:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.325362:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045336.325967:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11591:x1870706808810112:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 3179us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045336.325979:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:3.0:1784045336.332590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045336.332650:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808810368 00000100:00100000:0.0:1784045336.332660:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808810368 00000100:00100000:0.0:1784045336.332725:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:0.0:1784045336.332733:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+60:11591:x1870706808810368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045336.332751:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045336.332767:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbb5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000aa expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.332879:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.332891:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.332900:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045336.332924:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784045336.333007:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333013:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333017:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333021:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045336.333024:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333029:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333037:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045336.333039:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784045336.333042:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333046:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32a00/0xdb5b5ff6a2d2dbbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333078:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbb5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000aa expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333085:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:0.0:1784045336.333086:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045336.333094:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbb5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000aa expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.333100:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:0.0:1784045336.333157:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:11591:x1870706808810368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 426us (578us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1784045336.333163:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:1.0:1784045336.335406:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.335461:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808810496 00000100:00100000:2.0:1784045336.335468:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808810496 00000100:00100000:2.0:1784045336.335513:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:2.0:1784045336.335521:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:11591:x1870706808810496:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045336.335548:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045336.335637:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:11591:x1870706808810496:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.335642:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:3.0:1784045336.338724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045336.339395:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808810752 00000100:00100000:0.0:1784045336.339405:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808810752 00000100:00100000:0.0:1784045336.339475:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:0.0:1784045336.339486:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:11591:x1870706808810752:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045336.339505:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045336.339509:0:12196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784045336.339536:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045e00/0xdb5b5ff6a2d2db5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180008e expref: 61 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.339559:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045336.339564:0:12196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045336.339577:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000b1 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045336.341799:0:12196:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1784045336.342058:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.342075:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.342087:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.342168:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000b1 expref: 63 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.342186:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000b1 expref: 62 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.342196:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:0.0:1784045336.342199:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045336.342218:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32600, rc 0) 00000100:00100000:0.0:1784045336.342280:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+62:11591:x1870706808810752:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2795us (3563us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1784045336.342289:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:1.0:1784045336.351902:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.351967:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808811008 00000100:00100000:2.0:1784045336.352013:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808811008 00000100:00100000:2.0:1784045336.352130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:2.0:1784045336.352144:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+62:11591:x1870706808811008:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784045336.352206:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045336.352267:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32600/0xdb5b5ff6a2d2dbd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000b1 expref: 62 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352287:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa9118c5c00) 00010000:00010000:2.0:1784045336.352297:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045336.352319:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352333:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352377:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352391:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352398:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352404:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352489:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352496:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352502:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352508:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.352512:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352519:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352528:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045336.352530:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045336.352534:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352539:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dbdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352549:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352556:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352561:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352572:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.352575:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352581:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352589:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd337211d (ffff8aa902ec0100) 00010000:00010000:2.0:1784045336.352591:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045336.352594:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.352599:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dbe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd337211d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.352687:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:11591:x1870706808811008:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 546us (793us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045336.352696:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:1.0:1784045336.360224:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.360390:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808811136 00000100:00100000:2.0:1784045336.360400:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808811136 00000100:00100000:2.0:1784045336.360463:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:2.0:1784045336.360474:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+61:11591:x1870706808811136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045336.360494:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045336.360517:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dbed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000b8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.360553:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.360585:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.360597:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.360699:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dbed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 63 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.360717:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.360726:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:2.0:1784045336.360729:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045336.360733:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045336.360794:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+62:11591:x1870706808811136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 322us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.360802:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:3.0:1784045336.369106:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045336.369469:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808811392 00000100:00100000:0.0:1784045336.369480:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808811392 00000100:00100000:0.0:1784045336.369538:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:0.0:1784045336.369547:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+62:11591:x1870706808811392:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045336.369634:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.369653:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.369674:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045336.369956:0:12196:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1784045336.369965:0:12196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371056134508ns, next at 372056132421ns, rc = 0 00000004:00010000:0.0:1784045336.370062:0:12196:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014c0f3f6 reply state 00000000e7126594 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045336.370073:0:12196:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045336.370155:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+64:11591:x1870706808811392:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 608us (1060us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1784045336.370163:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 222 00010000:00010000:3.0:1784045336.373151:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.373167:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.373175:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.373180:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045336.373185:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.373193:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.373208:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:3.0:1784045336.373216:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784045336.373221:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.373227:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33e00/0xdb5b5ff6a2d2dbfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045336.373809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.373939:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808811520 00000100:00100000:2.0:1784045336.373949:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808811520 00000100:00100000:2.0:1784045336.374010:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 223 00000100:00100000:2.0:1784045336.374019:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+63:11591:x1870706808811520:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045336.374046:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045336.374065:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000bf expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.374125:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 64 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.374148:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 64 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.374167:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:2.0:1784045336.374170:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045336.374172:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045336.374239:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+64:11591:x1870706808811520:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 220us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.374246:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 223 00000100:00100000:1.0:1784045336.385552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045336.387996:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808811648 00000100:00100000:0.0:1784045336.388011:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808811648 00000100:00100000:0.0:1784045336.388109:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1784045336.388120:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2363:x1870706808811648:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784045336.388447:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:2363:x1870706808811648:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 329us (2904us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1784045336.388464:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00080000:2.0:1784045336.394102:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045336.401203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045336.401406:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808811904 00000100:00100000:3.0:1784045336.401417:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808811904 00000100:00100000:3.0:1784045336.401621:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:3.0:1784045336.401633:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+64:11591:x1870706808811904:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045336.401916:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+65:11591:x1870706808811904:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 285us (723us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1784045336.401924:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1784045336.411094:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.411213:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808812160 00000100:00100000:2.0:1784045336.411225:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808812160 00000100:00100000:2.0:1784045336.411297:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:2.0:1784045336.411307:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+65:11591:x1870706808812160:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784045336.411418:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+65:11591:x1870706808812160:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.411426:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:2.0:1784045336.416082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.416187:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808812288 00000100:00100000:1.0:1784045336.416198:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808812288 00000100:00100000:1.0:1784045336.416271:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 225 00000100:00100000:1.0:1784045336.416290:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+65:11591:x1870706808812288:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045336.416308:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045336.416328:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2dc09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000c6 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.416396:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.416410:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.416420:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045336.416466:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045336.416486:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.416508:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361400/0xdb5b5ff6a2d2dc09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000c6 expref: 67 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.416548:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000c6 expref: 66 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.416556:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:1.0:1784045336.416559:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784045336.416562:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361e00, rc 0) 00000100:00100000:1.0:1784045336.416615:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+66:11591:x1870706808812288:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 334us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.416622:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 225 00000100:00100000:3.0:1784045336.427773:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.427998:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808812416 00000100:00100000:1.0:1784045336.428008:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808812416 00000100:00100000:1.0:1784045336.428068:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:1.0:1784045336.428078:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+10:2361:x1870706808812416:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045336.428097:0:6600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045336.428118:0:6600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000cd expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784045336.428147:0:6600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f18, blocks: 0x1 00010000:00010000:1.0:1784045336.428167:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1784045336.428172:0:6600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045336.428182:0:6600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 11 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.428201:0:6600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 11 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.428232:0:6600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361400, rc 0) 00000100:00100000:1.0:1784045336.429293:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2361:x1870706808812416:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1204us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.429304:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:1.0:1784045336.443419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045336.443606:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808812672 00000100:00100000:3.0:1784045336.443616:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808812672 00000100:00100000:3.0:1784045336.443682:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:3.0:1784045336.443693:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+66:11591:x1870706808812672:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045336.443805:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+66:11591:x1870706808812672:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045336.443813:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:2.0:1784045336.450128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045336.450243:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808812800 00000100:00100000:0.0:1784045336.450253:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808812800 00000100:00100000:0.0:1784045336.450321:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1784045336.450332:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:11591:x1870706808812800:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045336.450351:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045336.450369:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000d4 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.450402:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.450412:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045336.450430:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045336.450437:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.450486:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.450501:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045336.450515:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829766784:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045336.450608:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045336.459756:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6599:1870706829766784:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045336.459797:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.459819:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32800, rc 0) 00000100:00100000:2.0:1784045336.459940:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:11591:x1870706808812800:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 9609us (9821us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.459949:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:1.0:1784045336.466547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045336.466651:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808812928 00000100:00100000:3.0:1784045336.466671:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808812928 00010000:00010000:3.0:1784045336.466714:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045336.466760:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1784045336.466770:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:2360:x1870706808812928:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045336.466789:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045336.466874:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.466891:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.466915:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2dc17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000cd expref: 12 pid: 6600 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.466931:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045336.466935:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045336.466944:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.466954:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.466990:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045336.467005:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906010000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5789:1870706829766912:192.168.201.58@tcp:105: 00000100:00100000:3.0:1784045336.467080:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045336.474482:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906010000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5789:1870706829766912:192.168.201.58@tcp:105: 00010000:00010000:3.0:1784045336.474510:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045336.474584:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2360:x1870706808812928:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 7814us (8046us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045336.474613:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1784045336.478515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.478669:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808813056 00000100:00100000:2.0:1784045336.478678:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808813056 00002000:00100000:2.0:1784045336.478728:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8aa93fd0a680 x1870706808813056/t0(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:732/0 lens 504/0 e 0 to 0 dl 1784045347 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045336.478740:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa93fd0a680 with x1870706808813056 ext(0->12) 00002000:00010000:2.0:1784045336.478747:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa93fd0a680 00000100:00100000:2.0:1784045336.478779:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784045336.478789:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+11:2360:x1870706808813056:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784045336.479297:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:2360:x1870706808813056:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 508us (790us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784045336.479305:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00002000:00100000:2.0:1784045336.479313:0:6603:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8aa93fd0a680 x1870706808813056/t4294967320(0) o4->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:732/0 lens 504/448 e 0 to 0 dl 1784045347 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045336.479322:0:6603:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa93fd0a680 with x1870706808813056 ext(0->12) 00002000:00010000:2.0:1784045336.479326:0:6603:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa93fd0a680 00000100:00100000:1.0:1784045336.491176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.491223:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808813184 00000100:00100000:1.0:1784045336.491231:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808813184 00000100:00100000:1.0:1784045336.491299:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 227 00000100:00100000:1.0:1784045336.491311:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+66:11591:x1870706808813184:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784045336.563110:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1784045336.563128:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1784045336.628510:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1784045336.628524:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1784045336.628578:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1784045336.628600:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1784045336.628617:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa910c8e300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1784045336.628622:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa90839f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa910c8ef00 00000020:00080000:3.0:1784045336.628626:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa90839f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa939d46800 00000100:00100000:2.0:1784045336.628626:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+43:11591:x1870706808813184:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 137313us (137452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.628637:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 227 00000001:00080000:3.0:1784045336.628641:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1784045336.628654:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa9060bc840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1784045336.628657:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa93f681300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa9060bcd80 00000020:00080000:3.0:1784045336.628669:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa93f681000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa93fad2800 00000100:00100000:2.0:1784045336.628866:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829767040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784045336.628921:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045336.629000:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829767040 00000100:00100000:0.0:1784045336.629008:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829767040 00000100:00100000:0.0:1784045336.629052:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045336.629061:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829767040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784045336.629088:0:6598:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1784045336.629119:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a565f17, atime: 0x6a565f17, ctime: 0x6a565f17, blocks: 0xb 00010000:00010000:0.0:1784045336.629127:0:6598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.629144:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1784045336.629149:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045336.629156:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.629172:0:6598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.629196:0:6598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.629216:0:6598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.629243:0:6598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784045336.629397:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829767168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784045336.629430:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.629456:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045336.629462:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829767296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784045336.629483:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.629506:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829767168 00000100:00100000:2.0:1784045336.629510:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829767168 00000100:00100000:2.0:1784045336.629537:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829767296 00000100:00100000:2.0:1784045336.629539:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829767296 00000100:00100000:2.0:1784045336.629550:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784045336.629555:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829767168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784045336.629568:0:8930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1784045336.629583:0:8930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.629597:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 12 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.629605:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784045336.629609:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045336.629613:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.629638:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 12 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.629654:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 12 pid: 8930 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.629689:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829767424:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045336.629729:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910c8e0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1784045336.629746:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045336.629797:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829767040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 737us (876us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784045336.629804:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045336.629819:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045336.629826:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829767296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784045336.629938:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1784045336.629943:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00010000:00010000:3.0:1784045336.629958:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045336.629964:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.629965:0:3321:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8aa937d32300 x1870706829767040/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784045352 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784045336.629973:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc16f3230) 00000004:00080000:2.0:1784045336.629977:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa937d32300/2, rc 0, transno 4294967310 00010000:00010000:3.0:1784045336.629978:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.629982:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829767040:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784045336.629987:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.630016:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.630025:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dc25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.630044:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045336.630046:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045336.630047:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784045336.630057:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1784045336.630230:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00010000:1.0:1784045336.633212:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784045336.633223:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784045336 00002000:00010000:1.0:1784045336.633226:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784045336.633228:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784045336 -> 1784045336 00002000:00010000:1.0:1784045336.633230:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1784045336.633334:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3318:x1870706829767296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3504us (3845us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1784045336.633346:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1784045336.633591:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa92d02c000/2, rc 0, transno 4294967321 00000100:00100000:2.0:1784045336.633599:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829767296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784045336.635098:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.635496:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808813312 00000100:00100000:2.0:1784045336.635506:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808813312 00000100:00100000:2.0:1784045336.635571:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:2.0:1784045336.635581:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:2362:x1870706808813312:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1784045336.642098:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829767424:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045336.642131:0:8930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.645385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.645425:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808813440 00000100:00100000:1.0:1784045336.645435:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808813440 00010000:00010000:1.0:1784045336.645486:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 14 pid: 8930 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.645525:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:1.0:1784045336.645535:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+14:2361:x1870706808813440:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045336.645552:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045336.645558:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 14 pid: 8930 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.645573:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 14 pid: 8930 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.645598:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2d9e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.58@tcp remote: 0x9edda05521800033 expref: 14 pid: 8930 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.645615:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045336.645619:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045336.645626:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.645636:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.645675:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045336.645726:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+13:2361:x1870706808813440:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 192us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.645744:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00010000:00010000:1.0:1784045336.648088:0:8930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.648109:0:8930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.648121:0:8930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.648129:0:8930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.648158:0:8930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045336.649764:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045336.649777:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.650008:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045336.650014:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.650026:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.650049:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.650056:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000867fb229/0xdb5b5ff6a2d2dc2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.650078:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045336.650080:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045336.650082:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045336.652124:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3318:x1870706829767168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22558us (22683us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1784045336.652137:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1784045336.652372:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa92d02f800/2, rc 0, transno 4294967322 00000100:00100000:2.0:1784045336.652379:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829767168:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784045336.732811:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+12:2362:x1870706808813312:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 97218us (97706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045336.732826:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:2.0:1784045336.735784:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045336.735885:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808813696 00000100:00100000:3.0:1784045336.735896:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808813696 00000100:00100000:3.0:1784045336.735956:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:3.0:1784045336.735967:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:11591:x1870706808813696:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045336.736019:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045336.736044:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000c6 expref: 20 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.736061:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:3.0:1784045336.736065:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045336.736099:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.736129:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.736140:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045336.736401:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ced23ada reply state 00000000f106bb4e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045336.736411:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045336.736520:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:11591:x1870706808813696:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 555us (744us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1784045336.736527:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 228 00000001:00080000:0.0:1784045336.737184:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1784045336.737199:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1784045336.737207:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00010000:00010000:3.0:1784045336.738581:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.738595:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.738602:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.738607:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045336.738612:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.738620:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.738635:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:3.0:1784045336.738648:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045336.738653:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.738670:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942044a00/0xdb5b5ff6a2d2dc33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.741360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.741459:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808813824 00000100:00100000:1.0:1784045336.741469:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808813824 00000100:00100000:1.0:1784045336.741529:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:1.0:1784045336.741539:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808813824:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784045336.741758:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784045336.741761:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1784045336 -> 1784045335 00002000:00010000:1.0:1784045336.741764:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784045335 00002000:00010000:1.0:1784045336.741766:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784045336 -> 1784045335 00002000:00010000:1.0:1784045336.741768:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1784045336.741937:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808813824:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 398us (586us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1784045336.741945:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1784045336.748262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.748360:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814080 00000100:00100000:2.0:1784045336.748370:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814080 00000100:00100000:2.0:1784045336.748444:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 229 00000100:00100000:2.0:1784045336.748464:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:11591:x1870706808814080:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784045336.748535:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.748561:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.748571:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.748604:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.748617:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 20 pid: 5806 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.748632:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829767552:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045336.748911:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045336.757283:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.757573:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829767552:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045336.757598:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.757684:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814208 00000100:00100000:1.0:1784045336.757691:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814208 00010000:00010000:1.0:1784045336.757727:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 21 pid: 5806 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.757768:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:1.0:1784045336.757777:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:2360:x1870706808814208:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045336.757792:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045336.757799:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 21 pid: 5806 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.757810:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 21 pid: 5806 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.757874:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dbf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000b8 expref: 21 pid: 5806 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.757890:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:1.0:1784045336.757894:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.757904:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.757911:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.757944:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045336.758001:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:2360:x1870706808814208:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 224us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.758009:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00010000:00010000:2.0:1784045336.758069:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758077:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758104:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758111:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758126:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758132:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.758137:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758144:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758154:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:2.0:1784045336.758156:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784045336.758160:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.758166:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.758219:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11591:x1870706808814080:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 9767us (9967us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784045336.758227:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 229 00000100:00100000:2.0:1784045336.761060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.761176:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814336 00000100:00100000:1.0:1784045336.761187:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814336 00000100:00100000:1.0:1784045336.761262:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:1.0:1784045336.761272:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2360:x1870706808814336:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784045336.761315:0:8930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.761336:0:8930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.761345:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045336.761349:0:8930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045336.761354:0:8930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.761625:0:8930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.761639:0:8930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 8 pid: 6599 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.761653:0:8930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829767680:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045336.761794:0:8930:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92ced9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045336.769437:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045336.770632:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814464 00000100:00100000:3.0:1784045336.770645:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814464 00010000:00010000:3.0:1784045336.770709:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 9 pid: 6599 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045336.770760:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1784045336.770770:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808814464:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045336.770785:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045336.770809:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 9 pid: 6599 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.770825:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 9 pid: 6599 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.770883:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045336.770888:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045336.770894:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.770904:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.770949:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045336.771000:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+9:2360:x1870706808814464:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 231us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045336.771008:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00010000:00010000:1.0:1784045336.771462:0:8930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dc1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda055218000d4 expref: 8 pid: 6599 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.771477:0:8930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8930:1870706829767680:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045336.771496:0:8930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771507:0:8930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771514:0:8930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771540:0:8930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771549:0:8930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771556:0:8930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771563:0:8930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045336.771568:0:8930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771589:0:8930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771602:0:8930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.771609:0:8930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2dc41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.771670:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808814336:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 10388us (10608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.771679:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:0.0:1784045336.774807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.774932:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814720 00000100:00100000:2.0:1784045336.774943:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814720 00000100:00100000:2.0:1784045336.774993:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:2.0:1784045336.775004:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11591:x1870706808814720:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784045336.775083:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775117:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775129:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775373:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775396:0:12196:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775405:0:12196:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775438:0:12196:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.775462:0:12196:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 20 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.775476:0:12196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1870706829767808:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045336.775560:0:12196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045336.779890:0:12196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1870706829767808:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045336.779923:0:12196:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045336.789936:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.790370:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814848 00000100:00100000:1.0:1784045336.790380:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814848 00010000:00010000:1.0:1784045336.790429:0:7496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 21 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045336.790479:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:1.0:1784045336.790488:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:2360:x1870706808814848:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045336.790503:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045336.790510:0:7496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 21 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.790536:0:7496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 21 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.790559:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dc02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218000bf expref: 21 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.790574:0:7496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:1.0:1784045336.790580:0:7496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.790589:0:7496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.790596:0:7496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.790627:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045336.790692:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:2360:x1870706808814848:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 204us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.790700:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00010000:00010000:2.0:1784045336.790869:0:12196:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.790878:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045336.791068:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1784045336.791513:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1784045336.791558:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1784045336.791629:0:12196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12196:1870706829767936:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784045336.791695:0:12196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.791725:0:12196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90830ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045336.793136:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829767936 00000100:00100000:1.0:1784045336.793148:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829767936 00000100:00100000:1.0:1784045336.793191:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784045336.793199:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12196:x1870706829767936:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784045336.793416:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12196:x1870706829767936:12345-0@lo:1000:mdt00_004.0 Request processed in 217us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.793423:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045336.793677:0:12196:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1784045336.793683:0:12196:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1784045336.793703:0:12196:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa92d02c000, transno 4294967321 00000100:00100000:2.0:1784045336.793723:0:12196:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8aa92d02f800 x1870706829767168/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784045352 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045336.793735:0:12196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12196:1870706829767936:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1784045336.797682:0:12196:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1784045336.797814:0:12196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12196:1870706829768064:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784045336.797916:0:12196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.797966:0:12196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045336.798244:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829768064 00000100:00100000:3.0:1784045336.798252:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829768064 00000100:00100000:3.0:1784045336.798307:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784045336.798316:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12196:x1870706829768064:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1784045336.798806:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12196:x1870706829768064:12345-0@lo:1000:mdt00_004.0 Request processed in 491us (889us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1784045336.798814:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1784045336.800981:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045336.801193:0:12196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12196:1870706829768064:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1784045336.801619:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801631:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801637:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801643:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.801672:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801680:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801694:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa902ec0300) 00010000:00010000:2.0:1784045336.801697:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045336.801701:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801707:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc4f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801735:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801741:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801747:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801752:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.801755:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801761:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801767:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045336.801770:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045336.801783:0:12196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801794:0:12196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.801802:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.802348:0:12196:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.802363:0:12196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1870706829768192:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784045336.803184:0:12196:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045336.819071:0:12196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12196:1870706829768192:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784045336.819101:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819113:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2db92 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819143:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819156:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819168:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819196:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819214:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819222:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819228:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.819232:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819240:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819252:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045336.819254:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045336.819258:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819262:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819272:0:12196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819278:0:12196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819284:0:12196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819295:0:12196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045336.819298:0:12196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819303:0:12196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819312:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045336.819315:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045336.819318:0:12196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.819323:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.819545:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11591:x1870706808814720:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 44542us (44748us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1784045336.819555:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 230 00000020:00080000:2.0:1784045336.819560:0:12196:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1784045336.820001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.820195:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808814976 00000100:00100000:2.0:1784045336.820212:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808814976 00000100:00100000:2.0:1784045336.820253:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1784045336.820263:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11590:x1870706808814976:12345-192.168.201.58@tcp:49:lfs.0 00000100:00100000:2.0:1784045336.820356:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11590:x1870706808814976:12345-192.168.201.58@tcp:49:lfs.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.820363:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000040:00080000:2.0:1784045336.822563:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045336.822570:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045336.823097:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784045336.823106:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045336.833594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.833678:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808815232 00000100:00100000:2.0:1784045336.833689:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808815232 00000100:00100000:2.0:1784045336.833751:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 231 00000100:00100000:2.0:1784045336.833761:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11590:x1870706808815232:12345-192.168.201.58@tcp:58:lfs.0 00000040:00080000:2.0:1784045336.834153:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1784045336.834256:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11590:x1870706808815232:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 496us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.834265:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 231 00000100:00100000:2.0:1784045336.836271:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.836355:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808815488 00000100:00100000:1.0:1784045336.836363:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808815488 00000100:00100000:1.0:1784045336.836411:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:1.0:1784045336.836421:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+23:11591:x1870706808815488:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784045336.837089:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784045336.837179:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1784045336.837218:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.837233:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.837244:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.837251:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.837257:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.837263:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045336.837280:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784045336.837352:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:11591:x1870706808815488:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 931us (1089us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1784045336.837359:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000020:00080000:1.0:1784045336.837363:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784045336.837633:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045336.837640:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.837647:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045336.837651:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.837668:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.837680:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8aa91040d400) 00010000:00010000:2.0:1784045336.837683:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784045336.837687:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.837693:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361e00/0xdb5b5ff6a2d2dc5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.837718:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045336.837720:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045336.837721:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045336.892910:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045336.893032:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808815616 00000100:00100000:2.0:1784045336.893042:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808815616 00000100:00100000:2.0:1784045336.893095:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:2.0:1784045336.893104:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+25:11593:x1870706808815616:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045336.893126:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045336.893146:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000db expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893216:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893231:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893242:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893255:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893262:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893269:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893548:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893564:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893572:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893605:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.893619:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 26 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045336.893633:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829768320:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045336.893725:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045336.898001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045336.898096:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808815872 00000100:00100000:1.0:1784045336.898104:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808815872 00000100:00100000:1.0:1784045336.898171:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:1.0:1784045336.898181:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:5577:x1870706808815872:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784045336.898448:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:5577:x1870706808815872:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 267us (456us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1784045336.898456:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1784045336.898768:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1870706829768320:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045336.898792:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045336.904315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045336.904611:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808816000 00000100:00100000:3.0:1784045336.904622:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808816000 00010000:00010000:3.0:1784045336.904674:0:7497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 28 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045336.904723:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1784045336.904733:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:2360:x1870706808816000:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045336.904749:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045336.904756:0:7497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 28 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.904769:0:7497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 28 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.904802:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2db84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180009c expref: 28 pid: 5805 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.904819:0:7497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045336.904825:0:7497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.904997:0:7497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045336.905004:0:7497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045336.905413:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045336.905486:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+27:2360:x1870706808816000:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 753us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.905496:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00010000:00010000:0.0:1784045336.906649:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906671:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045336.906717:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784045336.906721:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045336.906741:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906755:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906765:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906772:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906779:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906785:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045336.906789:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906798:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906810:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045336.906813:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045336.906819:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906953:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2dc6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906969:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906975:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906981:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906986:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045336.906989:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.906995:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.907004:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8aa902ec0300) 00010000:00010000:0.0:1784045336.907006:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045336.907010:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.907016:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2dc72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.907055:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dc64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000db expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.907069:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000db expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045336.907083:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045336.907085:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045336.907088:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721e00, rc 0) 00000100:00100000:0.0:1784045336.907181:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11593:x1870706808815616:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 14077us (14280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045336.907190:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:2.0:1784045336.993187:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829768704:0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.993266:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.993328:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045336.993335:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829768832:0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.993374:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.993408:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829768704 00000100:00100000:2.0:1784045336.993416:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829768704 00000100:00100000:2.0:1784045336.993482:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829768832 00000100:00100000:2.0:1784045336.993485:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829768832 00000100:00100000:2.0:1784045336.993506:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784045336.993514:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829768704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.994133:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829768704:12345-0@lo:400:kworker.0 Request processed in 618us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.994141:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784045336.994161:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784045336.994168:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829768832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.994198:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829768832:12345-0@lo:400:kworker.0 Request processed in 31us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.994203:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1784045336.994221:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045336.994252:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829768832:0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.994261:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829768704:0@lo:400:kworker.0 00000100:00100000:1.0:1784045336.994424:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829768576:0@lo:400:kworker.0 00000100:00100000:1.0:1784045336.994467:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045336.994495:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045336.994501:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829768448:0@lo:400:kworker.0 00000100:00100000:1.0:1784045336.994526:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045336.994979:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829768576 00000100:00100000:2.0:1784045336.994984:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829768576 00000100:00100000:2.0:1784045336.995023:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784045336.995031:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829768576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.995067:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829768576:12345-0@lo:400:kworker.0 Request processed in 37us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.995073:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784045336.995307:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829768960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045336.995340:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045336.995380:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829768448 00000100:00100000:3.0:1784045336.995385:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829768448 00000100:00100000:3.0:1784045336.995416:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1784045336.995423:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829768448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045336.995616:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3321:x1870706829768448:12345-0@lo:400:kworker.0 Request processed in 192us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045336.995622:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1784045336.995734:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3321:1870706829768448:0@lo:400:kworker.0 00000100:00100000:1.0:1784045336.995747:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829768576:0@lo:400:kworker.0 00000100:00100000:2.0:1784045336.995967:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829768960 00000100:00100000:2.0:1784045336.995979:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829768960 00000100:00100000:2.0:1784045336.996016:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784045336.996024:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829768960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045336.996043:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1784045336.996089:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1870706829768960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045336.996096:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045336.996415:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829768960:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1784045337.825599:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045337.825610:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045337.825677:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784045337.825684:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045337.825813:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829769088:192.168.201.58@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1784045337.827793:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045337.838267:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa802971300 going to sleep for 11 seconds 00000100:00100000:1.0:1784045337.881096:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11545:1870706829769088:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045337.881269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045337.881292:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808816128 00000100:00100000:1.0:1784045337.881298:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808816128 00000100:00100000:1.0:1784045337.881338:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 233 00000100:00100000:1.0:1784045337.881346:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11604:x1870706808816128:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784045337.881376:0:7507:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784045337.881473:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11604:x1870706808816128:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 126us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045337.881480:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 233 00000040:00080000:2.0:1784045337.888356:0:12429:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045337.888364:0:12429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045337.888414:0:12429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784045337.888420:0:12429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045337.907557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045337.914362:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808816384 00000100:00100000:0.0:1784045337.914377:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808816384 00000100:00100000:1.0:1784045337.914765:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:1.0:1784045337.914787:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+26:11604:x1870706808816384:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045337.914809:0:12196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045337.914853:0:12196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2dc80 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000e2 expref: -99 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045337.914958:0:12196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2dc87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045337.914973:0:12196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2dc87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045337.914986:0:12196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2dc87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045337.914999:0:12196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784045337.915136:0:12196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360000/0xdb5b5ff6a2d2dc80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000e2 expref: 29 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045337.915152:0:12196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2dc87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000e2 expref: 28 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045337.915161:0:12196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:1.0:1784045337.915164:0:12196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045337.915167:0:12196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361000, rc 0) 00000100:00100000:1.0:1784045337.915242:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11604:x1870706808816384:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 458us (7696us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1784045337.915250:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:0.0:1784045337.932591:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045337.932627:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808816640 00000100:00100000:0.0:1784045337.932646:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808816640 00000100:00100000:0.0:1784045337.932701:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 235 00000100:00100000:0.0:1784045337.932711:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11604:x1870706808816640:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784045337.932798:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.932819:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.932849:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933057:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933065:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933090:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933096:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045337.933100:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933107:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933119:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045337.933122:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784045337.933127:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.933133:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e33600/0xdb5b5ff6a2d2dc95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045337.933297:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:11604:x1870706808816640:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 584us (713us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1784045337.933305:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 235 00000040:00080000:0.0:1784045337.933418:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045337.933423:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045337.933939:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784045337.933948:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045337.934097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045337.934168:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808816768 00000100:00100000:0.0:1784045337.934173:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808816768 00000100:00100000:0.0:1784045337.934211:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784045337.934226:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:2363:x1870706808816768:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045337.934238:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045337.934253:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361000/0xdb5b5ff6a2d2dc87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000e2 expref: 29 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045337.934265:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:0.0:1784045337.934269:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045337.934296:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:2363:x1870706808816768:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045337.934302:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784045337.959093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045337.959348:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817024 00000100:00100000:3.0:1784045337.959358:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817024 00000100:00100000:3.0:1784045337.959421:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1784045337.959456:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+28:11604:x1870706808817024:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045337.959714:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:11604:x1870706808817024:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 261us (630us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1784045337.959723:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1784045338.529371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045338.529418:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045338.529458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045338.529497:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045338.529614:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817408 00000100:00100000:3.0:1784045338.529646:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817408 00000100:00100000:1.0:1784045338.529711:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817152 00000100:00100000:1.0:1784045338.529736:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817152 00000100:00100000:3.0:1784045338.529748:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1784045338.529767:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2363:x1870706808817408:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045338.529797:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 300 00000100:00100000:1.0:1784045338.529812:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808817152:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045338.529940:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2363:x1870706808817408:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 180us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045338.529949:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1784045338.531290:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817664 00000100:00100000:2.0:1784045338.531302:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817664 00000100:00100000:2.0:1784045338.531358:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817280 00000100:00100000:2.0:1784045338.531361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817280 00000100:00100000:2.0:1784045338.531389:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:2.0:1784045338.531397:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808817664:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045338.539023:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808817152:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 9202us (9649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045338.539040:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 300 00000100:00100000:1.0:1784045338.539110:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:1.0:1784045338.539121:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:2362:x1870706808817280:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045338.539174:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:2362:x1870706808817280:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 56us (9677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045338.539180:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00080000:1.0:1784045338.539236:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045338.539242:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045338.545569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045338.548580:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817536 00000100:00100000:1.0:1784045338.548595:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817536 00000100:00100000:1.0:1784045338.548695:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:1.0:1784045338.548709:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808817536:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045338.548795:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2362:x1870706808817536:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 90us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045338.548802:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00080000:0.0:1784045338.549034:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045338.553785:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2363:x1870706808817664:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 22377us (24315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045338.553801:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 162 00010000:00010000:2.0:1784045338.849247:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045339.872995:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045340.009020:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045340.009030:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045340.009078:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784045340.009084:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045340.084413:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045340.084435:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa906011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829769216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045340.084519:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045340.088072:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769216 00000100:00100000:2.0:1784045340.088085:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769216 00000100:00100000:2.0:1784045340.088169:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784045340.088180:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1870706829769216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045340.088219:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045340.088292:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1870706829769216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045340.088300:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784045340.088450:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa906011500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829769216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784045340.090596:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784045340.198714:0:12480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045340.198723:0:12480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045340.198768:0:12480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784045340.198773:0:12480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045340.526566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045340.526622:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808817920 00000100:00100000:2.0:1784045340.526632:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808817920 00000100:00100000:2.0:1784045340.526704:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00100000:2.0:1784045340.526713:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+29:11626:x1870706808817920:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045340.526732:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045340.526752:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2dc9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000e9 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045340.526870:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dca3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045340.526885:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045340.526899:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045340.526921:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784045340.527063:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2dc9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000e9 expref: 32 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045340.527084:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000e9 expref: 31 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045340.527093:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:2.0:1784045340.527096:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784045340.527100:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720800, rc 0) 00000100:00100000:2.0:1784045340.527157:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:11626:x1870706808817920:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 445us (601us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784045340.527164:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00080000:1.0:1784045340.528318:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045340.540661:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045340.540703:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818048 00000100:00100000:1.0:1784045340.540713:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818048 00000100:00100000:1.0:1784045340.540770:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:1.0:1784045340.540793:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:11626:x1870706808818048:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:1.0:1784045340.540890:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540908:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540919:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540945:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540952:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540959:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540965:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045340.540969:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540977:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.540988:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:1.0:1784045340.540991:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045340.540995:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045340.541001:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361a00/0xdb5b5ff6a2d2dcb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045340.541078:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+31:11626:x1870706808818048:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 298us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045340.541086:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:2.0:1784045340.655083:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045340.655177:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818176 00000100:00100000:3.0:1784045340.655188:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818176 00000100:00100000:3.0:1784045340.655270:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:3.0:1784045340.655281:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808818176:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:3.0:1784045340.655296:0:6598:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045340.655316:0:6598:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2dcb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000f0 expref: -99 pid: 6598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045340.655343:0:6598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a565f17, atime: 0x6a565f17, ctime: 0x6a565f17, blocks: 0xb 00010000:00010000:3.0:1784045340.655359:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1784045340.655375:0:6598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045340.655384:0:6598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2dcb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000f0 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045340.655413:0:6598:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2dcb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000f0 expref: 8 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045340.655426:0:6598:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044a00, rc 0) 00000100:00100000:3.0:1784045340.655484:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2361:x1870706808818176:12345-192.168.201.58@tcp:101:cat.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045340.655490:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00080000:1.0:1784045340.655663:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045340.668819:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045340.669163:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818304 00000100:00100000:2.0:1784045340.669173:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818304 00002000:00100000:2.0:1784045340.669235:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8aa92d02ea00 x1870706808818304/t0(0) o3->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:736/0 lens 488/0 e 0 to 0 dl 1784045351 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045340.669247:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa92d02ea00 with x1870706808818304 ext(0->4095) 00002000:00010000:2.0:1784045340.669252:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa92d02ea00 00000100:00100000:2.0:1784045340.669289:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045340.669298:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2362:x1870706808818304:12345-192.168.201.58@tcp:3:cat.0 00000100:00100000:2.0:1784045340.669664:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+8:2362:x1870706808818304:12345-192.168.201.58@tcp:3:cat.0 Request processed in 366us (855us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784045340.669673:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00002000:00100000:2.0:1784045340.669688:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8aa92d02ea00 x1870706808818304/t0(0) o3->4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1@192.168.201.58@tcp:736/0 lens 488/4536 e 0 to 0 dl 1784045351 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045340.669695:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8aa92d02ea00 with x1870706808818304 ext(0->4095) 00002000:00010000:2.0:1784045340.669699:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8aa92d02ea00 00010000:00010000:2.0:1784045340.897082:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784045341.662152:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1784045341.662174:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1784045341.662189:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1784045341.662200:0:5826:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8aa910d8d540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1784045341.662205:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa9057e8900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8aa910d8dd80 00000020:00080000:2.0:1784045341.662208:0:5826:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8aa9057e8400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8aa92d1a5400 00000020:00080000:1.0:1784045341.663094:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1784045341.663290:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1784045341.681379:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:1.0:1784045341.925311:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045342.113050:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829769600:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.113133:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.113183:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045342.113190:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829769728:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.113229:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.113262:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769600 00000100:00100000:2.0:1784045342.113268:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769600 00000100:00100000:2.0:1784045342.113318:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784045342.113328:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.113383:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829769600:12345-0@lo:400:kworker.0 Request processed in 57us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045342.113390:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784045342.113410:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769728 00000100:00100000:2.0:1784045342.113413:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769728 00000100:00100000:2.0:1784045342.113436:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784045342.113448:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3320:x1870706829769728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.113476:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3320:x1870706829769728:12345-0@lo:400:kworker.0 Request processed in 29us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045342.113482:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1784045342.113495:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045342.113500:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045342.113526:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829769728:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.113535:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829769600:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.113751:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829769472:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.113780:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.113801:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829769984:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.113822:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.113855:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784045342.113862:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829769344:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.113895:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.113917:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829769856:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.113934:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.113956:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769472 00000100:00100000:0.0:1784045342.113959:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769472 00000100:00100000:0.0:1784045342.113981:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769856 00000100:00100000:0.0:1784045342.113983:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769856 00000100:00100000:0.0:1784045342.114004:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784045342.114009:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829769472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114042:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829769472:12345-0@lo:400:kworker.0 Request processed in 32us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.114049:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784045342.114062:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784045342.114068:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114094:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829769856:12345-0@lo:400:kworker.0 Request processed in 26us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.114099:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784045342.114128:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769984 00000100:00100000:0.0:1784045342.114131:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769984 00000100:00100000:0.0:1784045342.114158:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784045342.114164:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829769984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114193:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829769984:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.114198:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784045342.114214:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829769344 00000100:00100000:0.0:1784045342.114217:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829769344 00000100:00100000:0.0:1784045342.114241:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784045342.114254:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829769344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114285:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829769344:12345-0@lo:400:kworker.0 Request processed in 33us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.114291:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:0.0:1784045342.114319:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045342.114322:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045342.114343:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829769344:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114353:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829769856:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114374:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829769472:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.114381:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1784045342.114386:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa937d32300, transno 4294967310 00000100:00100000:0.0:1784045342.114395:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829769984:0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.117711:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045342.117732:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829770112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045342.117789:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.117850:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770112 00000100:00100000:0.0:1784045342.117857:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770112 00000100:00100000:0.0:1784045342.117900:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045342.117908:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829770112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045342.117938:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045342.117979:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829770112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.117987:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045342.118039:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829770112:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1784045342.169604:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1784045342.169621:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1784045342.169628:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1784045342.945004:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045343.658269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045343.659001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045343.659038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045343.659064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045343.659086:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045343.659113:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818432 00000100:00100000:3.0:1784045343.659124:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818432 00000100:00100000:3.0:1784045343.659180:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 302 00000100:00100000:3.0:1784045343.659189:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808818432:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045343.659263:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808818432:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045343.659269:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 302 00000100:00100000:3.0:1784045343.659526:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818688 00000100:00100000:3.0:1784045343.659530:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818688 00000100:00100000:3.0:1784045343.659596:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818816 00000100:00100000:3.0:1784045343.659600:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818816 00000100:00100000:3.0:1784045343.659646:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784045343.659653:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808818688:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045343.659692:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808818688:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045343.659700:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00080000:1.0:1784045343.659749:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045343.659755:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045343.663307:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1784045343.663942:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808818816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045343.664062:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808818816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 733us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045343.664758:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818944 00000100:00100000:2.0:1784045343.664771:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818944 00000100:00100000:2.0:1784045343.664840:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808818560 00000100:00100000:2.0:1784045343.664843:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808818560 00000100:00100000:2.0:1784045343.664869:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:2.0:1784045343.664878:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808818944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045343.664929:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:2360:x1870706808818944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 52us (5890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045343.664937:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:2.0:1784045343.664958:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:2.0:1784045343.664965:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:2360:x1870706808818560:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045343.666052:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa906011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:2360:x1870706808818560:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 1083us (6983us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045343.666060:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00080000:2.0:1784045343.666089:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045343.673140:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00010000:00010000:1.0:1784045343.971006:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045344.993077:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045345.187027:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045345.187048:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9060b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829770240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045345.187145:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045345.187588:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770240 00000100:00100000:3.0:1784045345.187596:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770240 00000100:00100000:3.0:1784045345.187667:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784045345.187677:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829770240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045345.187720:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784045345.187849:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045345.188537:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829770240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 860us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045345.188547:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784045345.202983:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1784045345.203008:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8aa92d02f800, transno 4294967322 00000004:00080000:1.0:1784045345.203034:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1784045345.203075:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9060b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829770240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045346.022655:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784045346.833764:0:5826:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1784045346.833806:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1784045346.833816:0:5837:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1784045347.018008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045347.018122:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819072 00000100:00100000:0.0:1784045347.018133:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819072 00000100:00100000:0.0:1784045347.018215:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00100000:0.0:1784045347.018227:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:11271:x1870706808819072:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784045347.018346:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:11271:x1870706808819072:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.018355:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00080000:2.0:1784045347.018412:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045347.034666:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045347.034864:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819328 00000100:00100000:1.0:1784045347.034874:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819328 00000100:00100000:1.0:1784045347.034932:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:1.0:1784045347.034943:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:11271:x1870706808819328:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784045347.035435:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:11271:x1870706808819328:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 492us (778us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784045347.035453:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00010000:00010000:1.0:1784045347.041617:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045347.233103:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045347.233131:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829770368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045347.233210:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045347.233371:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770368 00000100:00100000:0.0:1784045347.233380:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770368 00000100:00100000:0.0:1784045347.233446:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784045347.233455:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829770368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045347.233497:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045347.233543:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829770368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.233549:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784045347.233638:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829770368:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784045347.234097:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045347.234211:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829770624:0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234243:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045347.234263:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045347.234268:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829770752:0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234287:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.234315:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829770880:0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234320:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770624 00000100:00100000:1.0:1784045347.234324:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770624 00000100:00100000:3.0:1784045347.234348:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045347.234354:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770752 00000100:00100000:1.0:1784045347.234357:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770752 00000100:00100000:3.0:1784045347.234371:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784045347.234376:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829770496:0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234382:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784045347.234387:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829770624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234401:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045347.234422:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829770624:12345-0@lo:400:kworker.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045347.234423:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829771008:0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234428:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784045347.234442:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784045347.234447:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829770752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234459:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045347.234469:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829770752:12345-0@lo:400:kworker.0 Request processed in 22us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045347.234475:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784045347.234505:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771008 00000100:00100000:1.0:1784045347.234508:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771008 00000100:00100000:3.0:1784045347.234510:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770880 00000100:00100000:3.0:1784045347.234512:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770880 00000100:00100000:1.0:1784045347.234524:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784045347.234529:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829771008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234540:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784045347.234545:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829770880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234560:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829771008:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045347.234566:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1784045347.234572:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829770880:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045347.234577:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1784045347.234589:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045347.234592:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045347.234593:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829770496 00000100:00100000:3.0:1784045347.234596:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829770496 00000100:00100000:1.0:1784045347.234611:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829770752:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234615:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784045347.234621:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829770496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.234621:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829770624:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234648:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829770496:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045347.234653:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784045347.234681:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829770496:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234691:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829771008:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.234699:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829770880:0@lo:400:kworker.0 00000100:00100000:1.0:1784045347.284419:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045347.284577:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819456 00000100:00100000:2.0:1784045347.284588:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819456 00000100:00100000:2.0:1784045347.284733:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00100000:2.0:1784045347.284744:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+5:12078:x1870706808819456:12345-192.168.201.58@tcp:101:lsof.0 00010000:00010000:2.0:1784045347.284763:0:7507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045347.284788:0:7507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dcbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218000f7 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045347.284875:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2dcc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045347.284886:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2dcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045347.284895:0:7507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2dcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045347.286696:0:7507:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784045347.286707:0:7507:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045347.286825:0:7507:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2dcc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7507 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045347.286877:0:7507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721800/0xdb5b5ff6a2d2dcbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000f7 expref: 7 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045347.286899:0:7507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2dcc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000f7 expref: 6 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045347.286918:0:7507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:2.0:1784045347.286921:0:7507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045347.286925:0:7507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045347.287013:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:12078:x1870706808819456:12345-192.168.201.58@tcp:101:lsof.0 Request processed in 2269us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045347.287023:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00080000:1.0:1784045347.287112:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784045348.068388:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045348.788635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045348.788684:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045348.788718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045348.788743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045348.788766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045348.788797:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819840 00000100:00100000:3.0:1784045348.788805:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819840 00000100:00100000:3.0:1784045348.788902:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819968 00000100:00100000:3.0:1784045348.788905:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819968 00000100:00100000:3.0:1784045348.788930:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1784045348.788940:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808819840:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045348.789009:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2361:x1870706808819840:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 71us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045348.789018:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1784045348.789034:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1784045348.789041:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2361:x1870706808819968:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045348.789066:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2361:x1870706808819968:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045348.789073:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1784045348.789227:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820096 00000100:00100000:1.0:1784045348.789232:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820096 00000100:00100000:1.0:1784045348.789272:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819712 00000100:00100000:1.0:1784045348.789275:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819712 00000100:00100000:1.0:1784045348.789301:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:1.0:1784045348.789308:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2361:x1870706808820096:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045348.789340:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2361:x1870706808820096:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045348.789346:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:1.0:1784045348.789360:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:1.0:1784045348.789367:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:2361:x1870706808819712:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045348.789395:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:2361:x1870706808819712:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045348.789409:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00080000:1.0:1784045348.789430:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045348.789434:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045348.789670:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808819584 00000100:00100000:2.0:1784045348.789675:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808819584 00000100:00100000:2.0:1784045348.789711:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 304 00000100:00100000:2.0:1784045348.789719:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808819584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045348.789758:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2361:x1870706808819584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 40us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045348.789765:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 304 00010000:00010000:1.0:1784045349.089139:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045350.113117:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784045350.241124:0:11545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045350.241133:0:11545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045350.241623:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1784045350.241630:0:11545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045350.307046:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045350.307156:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045350.307665:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771136 00000100:00100000:0.0:1784045350.307681:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771136 00000100:00100000:0.0:1784045350.307782:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784045350.307793:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045350.307861:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045350.308079:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 288us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045350.308087:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1784045350.308285:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045350.316240:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829771136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045351.137243:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784045351.931081:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:1.0:1784045352.162564:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784045352.329800:0:12685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:09:10 (1784045350) 00000100:00100000:1.0:1784045352.354975:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045352.354997:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829771264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045352.355081:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045352.355147:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771264 00000100:00100000:1.0:1784045352.355155:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771264 00000100:00100000:1.0:1784045352.355230:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045352.355239:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829771264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045352.355274:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045352.355318:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829771264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045352.355325:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1784045352.355346:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045352.355379:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829771264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045352.356769:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa90abdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829771392:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.356822:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045352.356883:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829771904:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.356924:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045352.356950:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045352.356956:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829771520:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.356979:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045352.357001:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829771776:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357170:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045352.357192:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045352.357198:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829771648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357221:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045352.357249:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771392 00000100:00100000:3.0:1784045352.357272:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771392 00000100:00100000:3.0:1784045352.357314:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784045352.357321:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829771392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357372:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829771392:12345-0@lo:400:kworker.0 Request processed in 51us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.357380:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784045352.357428:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771904 00000100:00100000:3.0:1784045352.357433:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771904 00000100:00100000:3.0:1784045352.357467:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771520 00000100:00100000:3.0:1784045352.357470:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771520 00000100:00100000:3.0:1784045352.357487:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771648 00000100:00100000:3.0:1784045352.357490:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771648 00000100:00100000:3.0:1784045352.357504:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784045352.357510:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829771904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357543:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1870706829771904:12345-0@lo:400:kworker.0 Request processed in 32us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.357549:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784045352.357561:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784045352.357566:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829771520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357593:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829771520:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.357599:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784045352.357610:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784045352.357615:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829771648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357645:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829771648:12345-0@lo:400:kworker.0 Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.357651:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784045352.357677:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829771776 00000100:00100000:3.0:1784045352.357680:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829771776 00000100:00100000:3.0:1784045352.357708:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784045352.357713:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829771776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357743:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829771776:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.357749:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784045352.357795:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829771648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357806:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829771776:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357867:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829771520:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357876:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa90abdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829771392:0@lo:400:kworker.0 00000100:00100000:3.0:1784045352.357884:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1870706829771904:0@lo:400:kworker.0 00000100:00080000:1.0:1784045352.358871:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045352.358878:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784045353.193072:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045353.896077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045353.896119:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045353.896144:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045353.896166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045353.896191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045353.896224:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820224 00000100:00100000:0.0:1784045353.896232:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820224 00000100:00100000:0.0:1784045353.896289:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 306 00000100:00100000:0.0:1784045353.896298:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808820224:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045353.896387:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2360:x1870706808820224:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 90us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045353.896396:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 306 00000100:00100000:0.0:1784045353.896431:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820480 00000100:00100000:0.0:1784045353.896435:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820480 00000100:00100000:0.0:1784045353.896482:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820608 00000100:00100000:0.0:1784045353.896485:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820608 00000100:00100000:0.0:1784045353.896506:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784045353.896512:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808820480:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045353.896541:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2360:x1870706808820480:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045353.896547:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784045353.896558:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784045353.896564:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808820608:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045353.896587:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2360:x1870706808820608:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045353.896601:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784045353.896618:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820736 00000100:00100000:0.0:1784045353.896622:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820736 00000100:00100000:0.0:1784045353.896646:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820352 00000100:00100000:0.0:1784045353.896649:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820352 00000100:00100000:0.0:1784045353.896668:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:0.0:1784045353.896675:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2360:x1870706808820736:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045353.896703:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2360:x1870706808820736:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045353.896710:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:0.0:1784045353.896721:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 178 00000100:00100000:0.0:1784045353.896727:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:2360:x1870706808820352:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045353.896750:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:2360:x1870706808820352:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045353.896756:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 178 00000100:00080000:0.0:1784045353.896777:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045353.896781:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045353.896783:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045354.209039:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045355.233543:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045355.425659:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045355.425688:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829772032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045355.425767:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045355.426248:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772032 00000100:00100000:1.0:1784045355.426258:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772032 00000100:00100000:1.0:1784045355.426337:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045355.426358:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829772032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045355.426393:0:6602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045355.426457:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829772032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045355.426465:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784045355.426514:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829772032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784045355.426718:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045356.257114:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045356.778695:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045356.785103:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808820992 00000100:00100000:2.0:1784045356.785119:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808820992 00000100:00100000:2.0:1784045356.785359:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1784045356.785373:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+18:12299:x1870706808820992:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:2.0:1784045356.785986:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:12299:x1870706808820992:12345-192.168.201.58@tcp:35:umount.0 Request processed in 614us (7785us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784045356.786001:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1784045356.793005:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045356.793299:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808821248 00000100:00100000:1.0:1784045356.793309:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808821248 00000100:00100000:1.0:1784045356.793375:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:1.0:1784045356.793386:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+19:12299:x1870706808821248:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:1.0:1784045356.793880:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:12299:x1870706808821248:12345-192.168.201.58@tcp:35:umount.0 Request processed in 494us (884us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1784045356.793889:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00080000:0.0:1784045356.796327:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045356.797820:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045356.798456:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808821504 00000100:00100000:3.0:1784045356.798469:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808821504 00000100:00100000:3.0:1784045356.798582:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:3.0:1784045356.798593:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90fb8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+20:12299:x1870706808821504:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:3.0:1784045356.799368:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90fb8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:12299:x1870706808821504:12345-192.168.201.58@tcp:35:umount.0 Request processed in 772us (1551us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1784045356.799378:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:2.0:1784045356.804186:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045356.804288:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808821760 00000100:00100000:1.0:1784045356.804299:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808821760 00000100:00100000:1.0:1784045356.804590:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:1.0:1784045356.804601:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:12299:x1870706808821760:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:1.0:1784045356.804976:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:12299:x1870706808821760:12345-192.168.201.58@tcp:35:umount.0 Request processed in 376us (800us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1784045356.804985:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1784045356.814513:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045356.814551:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045356.814585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045356.814668:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808821888 00000100:00100000:0.0:1784045356.814678:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808821888 00000100:00100000:0.0:1784045356.814740:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808822144 00000100:00100000:0.0:1784045356.814743:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808822144 00000100:00100000:0.0:1784045356.814783:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808822016 00000100:00100000:0.0:1784045356.814786:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808822016 00000100:00100000:0.0:1784045356.814803:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045356.814812:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+15:2363:x1870706808821888:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045356.814849:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045356.814883:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172800/0xdb5b5ff6a2d2ccdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc82 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045356.814900:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045356.814959:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+14:2363:x1870706808821888:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 147us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045356.814967:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045356.814999:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784045356.815005:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+13:2363:x1870706808822144:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045356.815014:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045356.815023:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2cf28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd4d expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045356.815031:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045356.815049:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+12:2363:x1870706808822144:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045356.815055:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784045356.815067:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784045356.815072:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:2363:x1870706808822016:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045356.815079:0:7497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045356.815087:0:7497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2cca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc4a expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045356.815103:0:7497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045356.815132:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808822016:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 59us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045356.815139:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784045356.819412:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045356.819518:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808822272 00000100:00100000:2.0:1784045356.819529:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808822272 00000100:00100000:2.0:1784045356.819606:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:2.0:1784045356.819615:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2359:x1870706808822272:12345-192.168.201.58@tcp:9:umount.0 00000020:00000080:2.0:1784045356.819649:0:6598:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2d016 00000100:00080000:2.0:1784045356.819659:0:6598:0:(import.c:65:import_set_state_nolock()) ffff8aa939d5f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784045356.819714:0:6598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1784045356.820074:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+2:2359:x1870706808822272:12345-192.168.201.58@tcp:9:umount.0 Request processed in 458us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045356.820083:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00080000:0.0:1784045356.820566:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784045356.824802:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045356.830146:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045356.830453:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808822656 00000100:00100000:1.0:1784045356.830476:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808822656 00000100:00080000:0.0:1784045356.830603:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045356.830643:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:1.0:1784045356.830653:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+7:2359:x1870706808822656:12345-192.168.201.58@tcp:9:umount.0 00000020:00000080:1.0:1784045356.830685:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2d27e 00000020:00010000:1.0:1784045356.830694:0:6599:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8aa9035cb800: total 0 00000100:00080000:1.0:1784045356.830699:0:6599:0:(import.c:65:import_set_state_nolock()) ffff8aa9035cf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784045356.830741:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1784045356.831041:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+5:2359:x1870706808822656:12345-192.168.201.58@tcp:9:umount.0 Request processed in 388us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045356.831050:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00000020:00010000:0.0:1784045356.831100:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8aa9035cb800: total 0 00010000:00010000:0.0:1784045356.831144:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8aa9035cb800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1784045356.831197:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9306b7/0xdb5b5ff6a2d2dcb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000f0 expref: 4 pid: 6598 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045356.831250:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2d61a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff22 expref: 3 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045356.831265:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8aa9035cb800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784045356.831277:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045356.831279:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045356.831280:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045356.839038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045356.839147:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808823680 00000100:00100000:1.0:1784045356.839157:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808823680 00000100:00100000:1.0:1784045356.839437:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:1.0:1784045356.839449:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+22:2359:x1870706808823680:12345-192.168.201.58@tcp:39:umount.0 00000020:00000080:1.0:1784045356.839481:0:12196:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ccb2 00000020:00010000:1.0:1784045356.839497:0:12196:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8aa93f751000: total 0 00000100:00080000:1.0:1784045356.839501:0:12196:0:(import.c:65:import_set_state_nolock()) ffff8aa93f753000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784045356.839531:0:12196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1784045356.839942:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1+21:2359:x1870706808823680:12345-192.168.201.58@tcp:39:umount.0 Request processed in 494us (914us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1784045356.839950:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 240 00000020:00010000:3.0:1784045356.840241:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8aa93f751000: total 0 00010000:00010000:3.0:1784045356.840246:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045356.840287:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8aa93f751000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1784045356.840347:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa92210c200) 00010000:00010000:3.0:1784045356.840351:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045356.840360:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa90148f000/0xdb5b5ff6a2d2cf98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd62 expref: 20 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840389:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045356.840392:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045356.840397:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360800/0xdb5b5ff6a2d2d67c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff3e expref: 19 pid: 12196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840413:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045356.840416:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784045356.840419:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2dca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000e9 expref: 18 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840431:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045356.840434:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045356.840437:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2d5db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff0d expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840449:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045356.840452:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045356.840455:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721e00/0xdb5b5ff6a2d2dc79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000db expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840468:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045356.840471:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045356.840475:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721c00/0xdb5b5ff6a2d2d977 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800017 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840501:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045356.840504:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045356.840508:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d360a00/0xdb5b5ff6a2d2d2d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffe49 expref: 14 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840521:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:3.0:1784045356.840523:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045356.840527:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2cf7c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd5b expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840597:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045356.840600:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784045356.840604:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32e00/0xdb5b5ff6a2d2d605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff1b expref: 12 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840615:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8aa91040d200) 00010000:00010000:3.0:1784045356.840617:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045356.840620:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720200/0xdb5b5ff6a2d2d4fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffed5 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840632:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8aa91040db00) 00010000:00010000:3.0:1784045356.840634:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784045356.840638:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa92d361c00/0xdb5b5ff6a2d2cfec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd77 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840650:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8aa91040dd00) 00010000:00010000:3.0:1784045356.840653:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045356.840663:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa939e32400/0xdb5b5ff6a2d2db99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000a3 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840680:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045356.840682:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784045356.840686:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942045c00/0xdb5b5ff6a2d2d698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217fff45 expref: 8 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045356.840701:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8aa93f751000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1784045356.840713:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045356.840715:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045356.840717:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784045356.997037:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000001:00080000:2.0:1784045356.997056:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1784045356.997077:0:5826:0:(genops.c:906:class_export_put()) final put ffff8aa93f751000/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:0.0:1784045356.997193:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f751000/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 for lustre-MDT0000 00000020:00000080:0.0:1784045356.997262:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f753000 for lustre-MDT0000 00000001:00100000:3.0:1784045357.009060:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:3.0:1784045357.009071:0:7510:0:(genops.c:906:class_export_put()) final put ffff8aa939d5e000/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:1.0:1784045357.010118:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa939d5e000/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 for lustre-OST0001 00000020:00000080:1.0:1784045357.010170:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa939d5f800 for lustre-OST0001 00010000:00010000:0.0:1784045357.281001:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045357.473396:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045357.473422:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829772160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045357.473487:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045357.473702:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772160 00000100:00100000:2.0:1784045357.473710:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772160 00000100:00100000:2.0:1784045357.473777:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784045357.473787:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829772160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045357.473818:0:6601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045357.473885:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829772160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045357.473898:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1784045357.473995:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045357.474031:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829772160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045357.475764:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829772544:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.475824:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.475891:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045357.475897:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829772416:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.475921:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.475949:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772544 00000100:00100000:0.0:1784045357.475956:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772544 00000100:00100000:0.0:1784045357.475998:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772416 00000100:00100000:0.0:1784045357.476001:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772416 00000100:00100000:0.0:1784045357.476021:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784045357.476029:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829772544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476074:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829772544:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.476081:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784045357.476095:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784045357.476117:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829772416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476142:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829772416:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.476148:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784045357.476174:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829772672:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476199:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.476222:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784045357.476228:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829772288:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476253:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.476281:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829772800:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476302:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.476339:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772672 00000100:00100000:0.0:1784045357.476343:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772672 00000100:00100000:0.0:1784045357.476368:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784045357.476374:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829772672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476406:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829772672:12345-0@lo:400:kworker.0 Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.476414:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1784045357.476430:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045357.476434:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045357.476458:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829772672:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476482:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829772416:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.476491:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829772544:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.476642:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772800 00000100:00100000:1.0:1784045357.476647:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772800 00000100:00100000:1.0:1784045357.476687:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784045357.476694:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829772800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.476742:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1870706829772800:12345-0@lo:400:kworker.0 Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.476748:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784045357.476778:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829772800:0@lo:400:kworker.0 00000100:00080000:0.0:1784045357.478403:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045357.478482:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772288 00000100:00100000:3.0:1784045357.478491:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772288 00000100:00100000:3.0:1784045357.478543:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784045357.478552:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829772288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045357.478631:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3320:x1870706829772288:12345-0@lo:400:kworker.0 Request processed in 80us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045357.478637:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1784045357.478740:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829772288:0@lo:400:kworker.0 00000001:00100000:2.0:1784045357.505438:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:2.0:1784045357.505448:0:6626:0:(genops.c:906:class_export_put()) final put ffff8aa9035cb800/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 00000020:00000080:1.0:1784045357.505530:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa9035cb800/4c85aa77-67a1-4750-8a7e-24fe2c5ef5d1 for lustre-OST0000 00000020:00000080:1.0:1784045357.505646:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa9035cf800 for lustre-OST0000 00000100:00100000:0.0:1784045358.043584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045358.043632:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045358.043735:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808823936 00000100:00100000:1.0:1784045358.043753:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808823936 00000100:00100000:1.0:1784045358.043897:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808823808 00000100:00100000:1.0:1784045358.043901:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808823808 00000100:00100000:3.0:1784045358.046083:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784045358.046107:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b5546e-953c-4b15-ba5e-c489141abaa9+11:2363:x1870706808823936:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045358.046128:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045358.046151:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2cf21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffd46 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.046170:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045358.046265:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b5546e-953c-4b15-ba5e-c489141abaa9+10:2363:x1870706808823936:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 168us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045358.046272:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784045358.046310:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784045358.046317:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b5546e-953c-4b15-ba5e-c489141abaa9+9:2363:x1870706808823808:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045358.046325:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045358.046334:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2cd8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffcc1 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.046343:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045358.046360:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:2363:x1870706808823808:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 44us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045358.046365:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:2.0:1784045358.049998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045358.050114:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808824064 00000100:00100000:1.0:1784045358.050125:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808824064 00000100:00100000:1.0:1784045358.050198:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784045358.050207:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b5546e-953c-4b15-ba5e-c489141abaa9+8:2363:x1870706808824064:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045358.050222:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045358.050241:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e33400/0xdb5b5ff6a2d2cd84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc97 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.050257:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045358.050324:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6b5546e-953c-4b15-ba5e-c489141abaa9+7:2363:x1870706808824064:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.050333:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:0.0:1784045358.054785:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045358.054885:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808824320 00000100:00100000:2.0:1784045358.054896:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808824320 00000100:00100000:2.0:1784045358.054975:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:2.0:1784045358.054988:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+6:2359:x1870706808824320:12345-192.168.201.58@tcp:39:umount.0 00000020:00000080:2.0:1784045358.055030:0:5804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cd99 00000020:00010000:2.0:1784045358.055039:0:5804:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8aa93a1ea000: total 0 00000100:00080000:2.0:1784045358.055043:0:5804:0:(import.c:65:import_set_state_nolock()) ffff8aa93a1e8000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1784045358.055108:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8aa93a1ea000: total 0 00010000:00010000:3.0:1784045358.055152:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8aa93a1ea000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784045358.055185:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa91040da00) 00010000:00010000:3.0:1784045358.055189:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045358.055197:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2dcc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218000f7 expref: 5 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.055220:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8aa93a1ea000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784045358.055231:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045358.055233:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045358.055235:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784045358.055343:0:5804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1784045358.055734:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1304b9c6-2799-4632-8cb2-8b086c3762a0+3:2359:x1870706808824320:12345-192.168.201.58@tcp:39:umount.0 Request processed in 749us (956us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1784045358.055743:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00080000:0.0:1784045358.055860:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045358.078140:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045358.078263:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808824576 00000100:00100000:1.0:1784045358.078272:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808824576 00000100:00100000:1.0:1784045358.078343:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 308 00000100:00100000:1.0:1784045358.078354:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+7:2359:x1870706808824576:12345-192.168.201.58@tcp:251:umount.0 00000020:00000080:1.0:1784045358.078415:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cc8f 00000020:00010000:1.0:1784045358.078423:0:5797:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8aa93f779000: total 0 00000100:00080000:1.0:1784045358.078428:0:5797:0:(import.c:65:import_set_state_nolock()) ffff8aa93f77f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784045358.078508:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b5546e-953c-4b15-ba5e-c489141abaa9+3:2359:x1870706808824576:12345-192.168.201.58@tcp:251:umount.0 Request processed in 155us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.078516:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 308 00000020:00010000:0.0:1784045358.079320:0:5792:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8aa93f779000: total 0 00010000:00010000:0.0:1784045358.079326:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045358.079372:0:5792:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8aa93f779000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784045358.079407:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030600/0xdb5b5ff6a2d2cce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055217ffc89 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045358.079421:0:5792:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8aa93f779000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1784045358.079441:0:5792:0:(genops.c:906:class_export_put()) final put ffff8aa93f779000/a6b5546e-953c-4b15-ba5e-c489141abaa9 00010000:00010000:0.0:1784045358.079459:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045358.079462:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045358.079464:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784045358.079493:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f779000/a6b5546e-953c-4b15-ba5e-c489141abaa9 for MGS 00000020:00000080:3.0:1784045358.079528:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f77f800 for MGS 00010000:00010000:3.0:1784045358.305438:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045359.334547:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784045359.691386:0:12884:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784045359.705981:0:12884:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784045359.706029:0:12884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.706045:0:12884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.706052:0:12884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.706071:0:12884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.706106:0:12884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784045359.706112:0:12884:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784045359.706132:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045359.706137:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784045359.706142:0:12884:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784045359.706168:0:12884:0:(import.c:65:import_set_state_nolock()) ffff8aa9391d2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784045359.706397:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829772928:0@lo:39:umount.0 00000100:00100000:2.0:1784045359.706480:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045359.706631:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045359.706644:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.706652:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045359.706657:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.706665:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045359.706672:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045359.706678:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045359.706681:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784045359.706683:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784045359.706709:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.706715:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045359.706743:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.706750:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2cd22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.706761:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045359.706763:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045359.706765:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045359.706785:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045359.706796:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829773056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045359.706871:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045359.707657:0:7507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829772928 00000100:00100000:0.0:1784045359.707665:0:7507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829772928 00000100:00100000:0.0:1784045359.707722:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784045359.707731:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa94191dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1870706829772928:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784045359.707757:0:7507:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca9e 00000100:00080000:0.0:1784045359.707765:0:7507:0:(import.c:65:import_set_state_nolock()) ffff8aa937733800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784045359.707806:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045359.707861:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa94191dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3317:x1870706829772928:12345-0@lo:39:umount.0 Request processed in 130us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045359.707869:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1784045359.707878:0:7507:0:(genops.c:906:class_export_put()) final put ffff8aa937736800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784045359.707900:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa937736800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784045359.707941:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa937733800 for lustre-MDT0000 00000100:00100000:3.0:1784045359.708591:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773056 00000100:00100000:3.0:1784045359.708600:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773056 00000100:00100000:3.0:1784045359.708653:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045359.708674:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3319:x1870706829773056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045359.708686:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045359.708703:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172e00/0xdb5b5ff6a2d2cd29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd22 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.708720:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045359.708765:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:3319:x1870706829773056:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045359.708772:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045359.708853:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3319:1870706829773056:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1784045359.709076:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa9391d2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784045359.709097:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829772928:0@lo:39:umount.0 00000100:00080000:3.0:1784045359.709982:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045359.709987:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784045359.709993:0:12884:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784045359.711006:0:12884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711021:0:12884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711027:0:12884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711034:0:12884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711050:0:12884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045359.711056:0:12884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711079:0:12884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711084:0:12884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711090:0:12884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711108:0:12884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784045359.711114:0:12884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711121:0:12884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711127:0:12884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711134:0:12884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711141:0:12884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784045359.711146:0:12884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711150:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045359.711152:0:12884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711157:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711166:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721400 already unused, calling callback (ffffffffc1cd9c20) 00010000:00010000:3.0:1784045359.711167:0:12884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045359.711170:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711173:0:12884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.711181:0:12884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784045359.711183:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045359.711184:0:12884:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:2.0:1784045359.711190:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045359.711195:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045359.711197:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1784045359.711199:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:01000004:3.0:1784045359.711209:0:12884:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784045359.711213:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1784045359.711217:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045359.711223:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1784045359.711230:0:12884:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8aa92ceb0000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784045359.711236:0:12884:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8aa93f8b1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784045359.711243:0:12884:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8aa93a1ea000 1304b9c6-2799-4632-8cb2-8b086c3762a0 192.168.201.58@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1784045359.711244:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784045359.711248:0:12884:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8aa903634d40) has exports, disconnecting them 00010000:00010000:2.0:1784045359.711250:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1784045359.711252:0:12884:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8aa92ceb0000), last request at 1784045357 00000020:00000080:3.0:1784045359.711258:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cc11 00000100:00080000:3.0:1784045359.711283:0:12884:0:(import.c:65:import_set_state_nolock()) ffff8aa92ceb2000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784045359.711285:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711291:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2cd30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd37 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711304:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784045359.711307:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711313:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784045359.711316:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711321:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784045359.711323:0:12884:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa92ceb0000): rc 0 00000020:00000080:3.0:1784045359.711326:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa92ceb0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784045359.711334:0:12884:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8aa93f8b1800), last request at 1784045357 00000020:00000080:3.0:1784045359.711337:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cb46 10000000:00010000:2.0:1784045359.711337:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784045359.711342:0:12884:0:(import.c:65:import_set_state_nolock()) ffff8aa93f8b3800 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1784045359.711342:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045359.711344:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784045359.711346:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:3.0:1784045359.711347:0:12884:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa93f8b1800): rc 0 00000020:00000080:3.0:1784045359.711349:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93f8b1800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1784045359.711356:0:12884:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb518c1da7ae0 00010000:00010000:2.0:1784045359.711359:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711364:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1784045359.711380:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:2.0:1784045359.711381:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045359.711382:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:2.0:1784045359.711387:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2cc49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cc50 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045359.711394:0:12884:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1784045359.711402:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045359.711405:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711410:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173400 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784045359.711413:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711419:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045359.711426:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045359.711440:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784045359.711442:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784045359.711444:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784045359.711457:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711463:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045359.711469:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711474:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173400/0xdb5b5ff6a2d2cf4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cf52 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711484:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045359.711487:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711493:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784045359.711496:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711502:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045359.711508:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045359.711512:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045359.711514:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784045359.711515:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784045359.711549:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711556:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045359.711562:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711568:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900031000/0xdb5b5ff6a2d2c9fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2ca04 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.711581:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045359.711583:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045359.711584:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045359.711599:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829773568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045359.711604:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045359.711662:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045359.711987:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045359.711991:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773568 00000100:00100000:2.0:1784045359.711994:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829773184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045359.711998:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773568 00000100:00100000:2.0:1784045359.712016:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045359.712035:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773184 00000100:00100000:1.0:1784045359.712038:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773184 00000100:00100000:2.0:1784045359.712042:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829773312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045359.712060:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784045359.712068:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829773568:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045359.712073:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045359.712079:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784045359.712090:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1784045359.712093:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942044e00/0xdb5b5ff6a2d2ca04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2c9fd expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045359.712094:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa94191c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829773440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045359.712110:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045359.712113:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045359.712132:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773312 00000100:00100000:2.0:1784045359.712136:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773312 00000100:00100000:1.0:1784045359.712140:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829773568:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045359.712147:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045359.712153:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773440 00000100:00100000:2.0:1784045359.712155:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773440 00000100:00100000:1.0:1784045359.712162:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045359.712166:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+19:3318:x1870706829773184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045359.712179:0:7496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045359.712187:0:7496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173200/0xdb5b5ff6a2d2cd37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd30 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.712195:0:7496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045359.712216:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:3318:x1870706829773184:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000020:00000080:0.0:1784045359.712561:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa92ceb0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784045359.712614:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f8b1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784045359.712636:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa92ceb2000 for lustre-MDT0000 00000020:00000080:0.0:1784045359.712640:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f8b3800 for lustre-MDT0000 00000100:00100000:2.0:1784045359.713932:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045359.713951:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+18:3320:x1870706829773312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045359.713982:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045359.713999:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2cc50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cc49 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.714021:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045359.714436:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+17:3320:x1870706829773312:12345-0@lo:103:ldlm_bl.0 Request processed in 492us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045359.714445:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045359.714464:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045359.714470:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+16:3320:x1870706829773440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045359.714480:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045359.714490:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e33800/0xdb5b5ff6a2d2cf52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf4b expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.714500:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045359.714522:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+15:3320:x1870706829773440:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045359.714528:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045359.714577:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829773184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045359.714586:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829773568:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1784045359.717392:0:12884:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784045359.717432:0:12884:0:(import.c:65:import_set_state_nolock()) ffff8aa93f8b1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784045359.717456:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784045359.717460:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1784045359.717471:0:12884:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784045359.717522:0:12884:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784045359.717532:0:12884:0:(import.c:65:import_set_state_nolock()) ffff8aa93f756800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784045359.717566:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8aa903634d40) has no exports 00000100:00100000:2.0:1784045359.718035:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829773696:0@lo:9:umount.0 00000100:00100000:2.0:1784045359.718117:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045359.718153:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829773824:0@lo:9:umount.0 00000100:00100000:2.0:1784045359.718175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045359.718218:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773696 00000100:00100000:2.0:1784045359.718253:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773696 00000100:00100000:2.0:1784045359.718315:0:8930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773824 00000100:00100000:2.0:1784045359.718319:0:8930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773824 00000100:00100000:2.0:1784045359.718341:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784045359.718349:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1870706829773696:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784045359.718373:0:8930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cb93 00000100:00080000:2.0:1784045359.718383:0:8930:0:(import.c:65:import_set_state_nolock()) ffff8aa937e2b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784045359.718418:0:8930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1784045359.718776:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3317:x1870706829773696:12345-0@lo:9:umount.0 Request processed in 426us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045359.718784:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784045359.718798:0:8930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784045359.718806:0:8930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1870706829773824:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784045359.719187:0:8930:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cc7a 00000100:00080000:2.0:1784045359.719194:0:8930:0:(import.c:65:import_set_state_nolock()) ffff8aa937e2d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784045359.719228:0:8930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1784045359.719430:0:8930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3317:x1870706829773824:12345-0@lo:9:umount.0 Request processed in 625us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045359.719436:0:8930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1784045359.719458:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045359.719462:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045359.719488:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045359.719514:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f8b1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784045359.719525:0:3317:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784045359.719527:0:3317:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045359.719530:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829773696:0@lo:9:umount.0 00000100:00080000:2.0:1784045359.719540:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f756800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784045359.719547:0:3317:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784045359.719557:0:3317:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045359.719559:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829773824:0@lo:9:umount.0 00010000:00010000:2.0:1784045359.719589:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045359.721503:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829773440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045359.721514:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa94191df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829773312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045359.722759:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:3.0:1784045359.742149:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8aa903634d40) has no exports 00000020:00000080:3.0:1784045359.823182:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca58 00000020:00000080:3.0:1784045359.823202:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93b581000/lustre-QMT0000_UUID 00000020:01000000:3.0:1784045359.823228:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784045359.823411:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045359.823422:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784045359.823427:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8aa93b5919c0) has no exports 00000020:00000080:0.0:1784045359.823979:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93b581000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784045359.827419:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca51 00000020:00000080:2.0:1784045359.827433:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93b581800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784045359.827599:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93b581800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784045359.827691:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045359.827704:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784045359.827709:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93b583000/lustre-QMT0000_UUID 00000020:00000080:2.0:1784045359.827711:0:12884:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93b583000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784045359.827722:0:12884:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1784045360.353213:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045361.377069:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784045362.124944:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045362.124953:0:7510:0:(genops.c:906:class_export_put()) final put ffff8aa937e2a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045362.124981:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa937e2a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784045362.125035:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa937e2d000 for lustre-OST0001 00000001:00100000:3.0:1784045362.131822:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1304b9c6-2799-4632-8cb2-8b086c3762a0 00000001:00080000:3.0:1784045362.131905:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1784045362.131910:0:5826:0:(genops.c:906:class_export_put()) final put ffff8aa93a1ea000/1304b9c6-2799-4632-8cb2-8b086c3762a0 00000020:00000080:0.0:1784045362.131984:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93a1ea000/1304b9c6-2799-4632-8cb2-8b086c3762a0 for lustre-MDT0000 00000020:00000080:0.0:1784045362.132162:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93a1e8000 for lustre-MDT0000 00010000:00010000:2.0:1784045362.401210:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045362.593859:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829774080:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.593936:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045362.594002:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045362.594008:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829774208:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.594033:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045362.594063:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829774080 00000100:00100000:3.0:1784045362.594086:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829774080 00000100:00100000:3.0:1784045362.594123:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829774208 00000100:00100000:3.0:1784045362.594125:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829774208 00000100:00100000:3.0:1784045362.594146:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784045362.594153:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1870706829774080:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784045362.594161:0:5806:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784045362.594204:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1870706829774080:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784045362.594211:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1784045362.594238:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1784045362.594243:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1870706829774208:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784045362.594247:0:5806:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784045362.594269:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa90abdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1870706829774208:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784045362.594275:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1784045362.594308:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784045362.594313:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784045362.594316:0:3320:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1784045362.594698:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045362.594712:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829773952:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.594760:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.594802:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829773952 00000100:00100000:2.0:1784045362.594806:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829773952 00000100:00100000:2.0:1784045362.594855:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784045362.594862:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:3318:x1870706829773952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.594905:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9060f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b+14:3318:x1870706829773952:12345-0@lo:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045362.594912:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1784045362.594951:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829773952:0@lo:400:kworker.0 00000100:00080000:3.0:1784045362.609933:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045362.609946:0:3320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 199 00000100:00080000:3.0:1784045362.609955:0:3320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8aa941ceb000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045362.610942:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f739c00 x1870706829774336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045362.610988:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1870706829774208:0@lo:400:kworker.0 00000100:00080000:2.0:1784045362.611070:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784045362.611075:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8aa93fa79800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784045362.611078:0:3320:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784045362.611082:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8aa93fa79800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045362.611085:0:3320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 177 00000100:00080000:2.0:1784045362.611091:0:3320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8aa93fa79800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045362.611105:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f739880 x1870706829774464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045362.611115:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829774080:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.611600:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829774336:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784045362.611781:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045362.611812:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829774464:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784045362.611847:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045362.611886:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829774336 00000100:00100000:3.0:1784045362.611899:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829774336 00000100:00100000:3.0:1784045362.611939:0:12196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829774464 00000100:00100000:3.0:1784045362.611942:0:12196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829774464 00000100:00100000:3.0:1784045362.611962:0:12196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1784045362.611970:0:12196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3317:x1870706829774336:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1784045362.611986:0:12196:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784045362.612133:0:7507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784045362.612139:0:7507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1870706829774464:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1784045362.612154:0:7507:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1784045362.612196:0:7507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1870706829774464:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 55us (347us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784045362.612203:0:7507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1784045362.612500:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93fa79800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045362.612506:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784045362.614672:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829774464:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784045362.623732:0:12196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3317:x1870706829774336:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 11752us (11942us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045362.623748:0:12196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1784045362.623808:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045362.623813:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045362.623817:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829774336:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1784045362.669926:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045362.669950:0:6626:0:(genops.c:906:class_export_put()) final put ffff8aa937e2f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045362.672797:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa937e2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784045362.672916:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa937e2b800 for lustre-OST0000 00010000:00010000:2.0:1784045363.425140:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045364.456901:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045365.473127:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1784045365.921133:0:12884:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa91255ac60 - data ffff8aa9333ebbd0/ffff8aa937d24c00 00000020:01000000:2.0:1784045365.921272:0:12884:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa929069840 - data ffff8aa93335d510/ffff8aa910cff400 00000001:00000004:2.0:1784045365.933463:0:12884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1784045366.006767:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784045366.006776:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1784045366.006790:0:12884:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784045366.006793:0:12884:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784045366.008314:0:6931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784045366.008322:0:6931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1784045366.008334:0:6931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784045366.009525:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784045366.009532:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1784045366.009550:0:12884:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784045366.009553:0:12884:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784045366.010280:0:7920:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784045366.010295:0:7920:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1784045366.010303:0:7920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1784045366.066445:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca20 00000020:00000080:3.0:1784045366.066458:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa91077f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784045366.066729:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa91077f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784045366.068493:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca35 00000020:00000080:3.0:1784045366.068505:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa910778000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784045366.069390:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784045366.069400:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045366.069409:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784045366.069413:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8aa903630000) has no exports 00000004:01000000:3.0:1784045366.069591:0:12884:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784045366.069601:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cc73 00000020:00000080:3.0:1784045366.069608:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa937e2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045366.069698:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa910778000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784045366.069787:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784045366.069791:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045366.069799:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784045366.069801:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8aa9060c19c0) has no exports 00000020:00000080:3.0:1784045366.069809:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cc6c 00000020:00000080:3.0:1784045366.069825:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93f757000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784045366.070249:0:12884:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784045366.070254:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784045366.070259:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1784045366.070265:0:12884:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784045366.070267:0:12884:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784045366.070301:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045366.070308:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784045366.070312:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cb8c 00000020:00000080:3.0:1784045366.070316:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93fa79000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784045366.070319:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784045366.070322:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045366.070325:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784045366.070328:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8aa907e919c0) has no exports 00000020:00000080:3.0:1784045366.070331:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cb85 00000020:00000080:3.0:1784045366.070333:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa93f8b5000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1784045366.070627:0:12884:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784045366.070630:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784045366.070632:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1784045366.070635:0:12884:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784045366.070636:0:12884:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784045366.070660:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045366.070665:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784045366.070688:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045366.070690:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784045366.070693:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa937731000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045366.070696:0:12884:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa937731000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784045366.070703:0:12884:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784045366.070896:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca3c 00000020:00000080:3.0:1784045366.070901:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa910779000/lustre-MDD0000_UUID 00000020:01000000:3.0:1784045366.070908:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784045366.070917:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045366.070921:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784045366.070923:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8aa903633380) has no exports 00000020:00000080:3.0:1784045366.070945:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045366.070948:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784045366.070952:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca43 00000020:00000080:3.0:1784045366.070956:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa91077d000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784045366.070963:0:12884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa90538d800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784045366.070967:0:12884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa90538d800 3 00000020:01000004:3.0:1784045366.070970:0:12884:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa90538d800 from lustre-MDT0000 00000020:00000080:3.0:1784045366.070992:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045366.070996:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784045366.070998:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa91077a000/lustre-MDT0000_UUID 00000020:00000080:3.0:1784045366.071001:0:12884:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa91077a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784045366.071009:0:12884:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784045366.071034:0:12884:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1784045366.071038:0:12884:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784045366.071040:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784045366.071043:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045366.071045:0:12884:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784045366.071051:0:12884:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8aa903870800 fa48aca7-8b52-46ad-960b-10d4ed6c2d8b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784045366.071057:0:12884:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8aa907f40000) has exports, disconnecting them 00000020:00080000:3.0:1784045366.071060:0:12884:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8aa903870800), last request at 1784045124 00000020:00000080:3.0:1784045366.071075:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2c9e1 00000020:00010000:3.0:1784045366.071079:0:12884:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8aa903870800: total 6 00000100:00080000:3.0:1784045366.071083:0:12884:0:(import.c:65:import_set_state_nolock()) ffff8aa903876000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784045366.071098:0:12884:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa903870800): rc 0 00000020:00080000:3.0:1784045366.071102:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8aa907f40000) has no exports 00000100:00100000:3.0:1784045366.071178:0:5796:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8aa9060eca00:5796] 0 exiting: rc = 1 00000100:00100000:3.0:1784045366.071260:0:5799:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8aa90631ac00:5799] 2 exiting: rc = 0 00000020:00010000:2.0:1784045366.071459:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8aa903870800: total 6 00010000:00010000:2.0:1784045366.071492:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8aa903870800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1784045366.071518:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031400/0xdb5b5ff6a2d2ccff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ccf8 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071536:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031e00/0xdb5b5ff6a2d2cd0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd06 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071548:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937721200/0xdb5b5ff6a2d2cf36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf2f expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071560:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030400/0xdb5b5ff6a2d2cd1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd14 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071570:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2cf44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cf3d expref: 5 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071584:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900031c00/0xdb5b5ff6a2d2caf9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2caf2 expref: 4 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071595:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720e00/0xdb5b5ff6a2d2cd45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2cd3e expref: 3 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071606:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa900030a00/0xdb5b5ff6a2d2ccf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ccea expref: 2 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.071615:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8aa903870800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1784045366.071627:0:5793:0:(genops.c:906:class_export_put()) final put ffff8aa903870800/fa48aca7-8b52-46ad-960b-10d4ed6c2d8b 00010000:00010000:2.0:1784045366.071632:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045366.071641:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045366.071643:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045366.071702:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa937e2f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784045366.071709:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f757000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784045366.071715:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f756800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784045366.071720:0:8:0:(genops.c:906:class_export_put()) final put ffff8aa937e29800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045366.071722:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa937e29800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784045366.071725:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045366.071766:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93fa79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784045366.071771:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f8b5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784045366.071775:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93f8b1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784045366.071778:0:8:0:(genops.c:906:class_export_put()) final put ffff8aa93f8b5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045366.071779:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93f8b5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784045366.071782:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045366.071969:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa910779000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784045366.071973:0:8:0:(genops.c:906:class_export_put()) final put ffff8aa91077c800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784045366.071974:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa91077c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784045366.071978:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784045366.072132:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa91077d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784045366.072141:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa903870800/fa48aca7-8b52-46ad-960b-10d4ed6c2d8b for MGS 00000100:00100000:1.0:1784045366.072459:0:5797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8aa90631b400:5797] 1 exiting: rc = 0 00000100:00100000:3.0:1784045366.072772:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072786:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072801:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072808:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072814:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072820:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072825:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072849:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072855:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072861:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072867:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072874:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072879:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072886:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072890:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072895:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072901:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072907:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072911:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072917:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072923:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072928:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072933:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072939:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072944:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072949:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072954:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072959:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072965:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072980:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072987:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072992:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.072997:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073002:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073008:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073014:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073019:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073032:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073037:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073043:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073048:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073053:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073058:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073064:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073069:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073074:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073080:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073084:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073089:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073094:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073098:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073104:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073109:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073114:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073119:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073124:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073129:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073135:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073140:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073145:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073151:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073171:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073177:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.073182:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1784045366.073528:0:12884:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784045366.073531:0:12884:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1784045366.074195:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa903876000 for MGS 00000020:01000000:3.0:1784045366.074690:0:12884:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa9083102a0 - data ffff8aa93335cbd0/ffff8aa92d310000 00000020:01000000:3.0:1784045366.074800:0:12884:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa9105dc780 - data ffff8aa9333c6af8/ffff8aa906173800 00000020:00000080:3.0:1784045366.075291:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2c9c5 00000020:00000080:3.0:1784045366.075298:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa903958000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784045366.075307:0:12884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa90538d800 from MGS, refs=2 00000020:01000004:3.0:1784045366.075317:0:12884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa90538d800 2 00000020:01000004:3.0:1784045366.075320:0:12884:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa90538d800 from MGS 00000020:00000080:3.0:1784045366.075344:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045366.075350:0:12884:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784045366.075353:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa914eb2000/MGS 00000020:00000080:3.0:1784045366.075356:0:12884:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa914eb2000/MGS for MGS 00000020:01000000:3.0:1784045366.075361:0:12884:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784045366.075413:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784045366.075416:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045366.075421:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784045366.075427:0:12884:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8aa9391d7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784045366.075433:0:12884:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8aa907f43380) has exports, disconnecting them 00000020:00080000:3.0:1784045366.075437:0:12884:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8aa9391d7800), last request at 1784045126 00000020:00000080:3.0:1784045366.075441:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2ca90 00000020:00080000:3.0:1784045366.075449:0:12884:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa9391d7800): rc 0 00000020:00000080:3.0:1784045366.075453:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa9391d7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784045366.076131:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa903958000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784045366.076143:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa9391d7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784045366.079906:0:12884:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784045366.079914:0:12884:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784045366.079918:0:12884:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784045366.079927:0:12884:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045366.080083:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045366.080092:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784045366.080099:0:12884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa90538d800 1 00000020:00000080:2.0:1784045366.080105:0:12884:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2c9b7 00000020:00000080:2.0:1784045366.080115:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa914eb6000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1784045366.080122:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784045366.080126:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045366.080130:0:12884:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784045366.080134:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8aa907f419c0) has no exports 00000020:00000080:0.0:1784045366.082567:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa9391d2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784045366.082582:0:8:0:(genops.c:906:class_export_put()) final put ffff8aa9391d4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784045366.082585:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa9391d4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784045366.082593:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784045366.082669:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa914eb6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784045366.111578:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045366.111595:0:12884:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784045366.111601:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa914eb4000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784045366.111606:0:12884:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa914eb4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784045366.111620:0:12884:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784045366.111761:0:12884:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8aa914eb3800 00000020:01000000:0.0:1784045366.111782:0:12884:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1784045366.111786:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045366.111790:0:12884:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784045366.111794:0:12884:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8aa9036319c0) has no exports 00000100:00100000:0.0:1784045366.111896:0:12196:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8aa92edc4000:12196] 4 exiting: rc = 0 00000100:00100000:2.0:1784045366.112189:0:5806:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8aa910448200:5806] 2 exiting: rc = 0 00000100:00100000:2.0:1784045366.112256:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8aa9106df200:5804] 0 exiting: rc = 1 00000100:00100000:1.0:1784045366.112408:0:5805:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8aa9106df000:5805] 1 exiting: rc = 0 00000100:00100000:1.0:1784045366.112476:0:7507:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8aa92edc5000:7507] 3 exiting: rc = 0 00000100:00100000:0.0:1784045366.112916:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112927:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112933:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112939:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112945:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112961:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112968:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112974:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112979:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.112985:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113003:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113008:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113014:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113020:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113028:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113034:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113040:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113045:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113050:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113056:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113061:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113067:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113074:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113080:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113085:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113091:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113096:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113103:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113108:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113114:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113120:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113125:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113130:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113135:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113141:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113146:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113152:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113169:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113175:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113182:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113187:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113193:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113199:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113204:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113209:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113222:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113228:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113234:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113239:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113244:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113250:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113255:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113260:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113265:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113271:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113277:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113282:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113288:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113293:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113298:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113303:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113308:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113312:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.113325:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045366.121320:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8aa9061bf000:5807] 0 exiting: rc = 1 00000100:00100000:2.0:1784045366.121626:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8aa9061dba00:5808] 1 exiting: rc = 0 00000100:00100000:0.0:1784045366.121723:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121799:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121806:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121811:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121817:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121823:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121859:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121866:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121872:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121878:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121885:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121891:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121897:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121902:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121907:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121911:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121929:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121935:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121940:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.121945:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122075:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122084:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122090:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122095:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122100:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122105:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122110:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122115:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122120:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122125:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122130:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122136:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122141:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122146:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122151:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122156:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122172:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122178:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122184:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122188:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122194:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122200:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122205:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122211:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122215:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122220:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122226:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122231:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122236:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122240:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122244:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122259:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122264:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122269:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122274:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122278:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122283:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122289:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122295:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122300:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122306:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122311:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122320:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.122325:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045366.123397:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8aa908a41c00:5810] 1 exiting: rc = 0 00000100:00100000:0.0:1784045366.123552:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8aa910150000:5809] 0 exiting: rc = 1 00000100:00100000:0.0:1784045366.123632:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123642:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123648:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123655:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123662:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123669:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123674:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123680:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123687:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123693:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123700:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123705:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123711:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123799:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123808:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123815:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123821:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123856:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123864:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123870:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123877:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123893:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123899:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123905:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123912:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123934:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.123943:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124011:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124020:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124026:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124032:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124039:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124046:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124053:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124059:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124066:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124072:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124093:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124101:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124107:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124113:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124120:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124125:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124130:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124136:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124142:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124148:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124153:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124171:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124191:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124200:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124206:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124213:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124219:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124226:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124233:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124247:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124254:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124261:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124267:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124273:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124279:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124286:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.124298:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045366.134875:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8aa908a40600:5811] 0 exiting: rc = 1 00000100:00100000:3.0:1784045366.135194:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8aa908a41a00:5812] 1 exiting: rc = 0 00000100:00100000:0.0:1784045366.135350:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135369:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135376:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135381:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135387:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135392:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135397:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135402:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135408:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135414:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135419:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135425:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135431:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135437:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135442:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135447:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135452:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135457:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135461:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135466:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135470:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135474:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135479:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135484:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135488:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135493:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135498:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135515:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135521:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135527:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135533:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135538:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135543:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135548:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135553:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135558:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135563:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135568:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135573:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135578:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135583:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135588:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135594:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135600:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135604:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135609:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135614:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135619:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135624:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135629:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135634:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135640:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135645:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135651:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135655:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135661:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135666:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135671:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135676:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135681:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135685:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135690:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135701:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.135706:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045366.136887:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8aa908a47c00:5814] 1 exiting: rc = 0 00000100:00100000:3.0:1784045366.137135:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8aa908a46000:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1784045366.137286:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137293:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137299:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137304:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137310:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137315:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137320:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137325:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137330:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137336:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137341:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137346:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137351:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137356:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137371:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137377:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137382:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137387:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137393:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137398:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137402:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137407:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137412:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137416:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137421:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137427:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137431:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137436:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137441:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137446:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137451:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137456:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137461:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137475:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137481:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137486:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137491:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137496:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137501:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137507:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137512:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137516:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137521:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137526:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137532:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137537:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137542:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137547:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137552:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137557:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137565:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137570:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137576:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137581:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137587:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137592:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137597:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137602:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137607:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137612:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137617:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137622:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137627:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.137632:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045366.138274:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8aa90367f600:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1784045366.138337:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8aa93912d000:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1784045366.138472:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138478:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138482:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138487:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138501:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138505:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138510:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138515:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138520:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138527:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138533:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138538:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138544:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138549:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138554:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138560:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138565:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138570:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138574:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138578:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138583:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138589:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138594:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138599:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138603:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138609:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138614:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138618:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138623:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138628:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138633:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138637:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138641:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138646:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138651:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138656:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138661:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138667:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138672:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138687:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138692:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138698:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138703:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138708:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138713:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138719:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138724:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138740:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138746:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138751:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138756:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138761:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138766:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138772:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138777:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138781:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138786:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138791:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138796:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138801:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138806:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138810:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138815:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.138820:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045366.139926:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8aa90367e000:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1784045366.140094:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8aa93912c400:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1784045366.140464:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8aa90367ee00:5819] 2 exiting: rc = 0 00000100:00100000:0.0:1784045366.140532:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140540:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140546:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140552:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140558:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140564:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140569:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140575:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140580:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140596:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140600:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140622:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140628:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140633:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140638:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140644:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140649:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140655:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140661:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140667:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140672:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140678:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140684:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140689:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140698:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140703:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140709:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140715:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140720:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140726:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140741:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140747:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140752:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140757:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140763:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140786:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140793:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140798:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140803:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140809:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140814:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140819:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140826:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140856:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140869:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140874:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140880:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140885:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140890:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140895:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140900:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140906:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140911:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140916:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140921:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140927:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140933:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140939:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.140944:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.141345:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.141409:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.141417:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.141422:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045366.141436:0:12884:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784045366.147351:0:12884:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045366.147377:0:12884:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1784045366.147384:0:12884:0:(genops.c:906:class_export_put()) final put ffff8aa907e21000/MDS_uuid 00000020:00000080:0.0:1784045366.147390:0:12884:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907e21000/MDS_uuid for MDS 00000020:01000000:0.0:1784045366.147396:0:12884:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1784045366.147512:0:12884:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784045366.498129:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045367.521010:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045367.713035:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784045367.713042:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784045367.713045:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa93fa79800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045367.713053:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 397 00000100:00080000:2.0:1784045367.713059:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784045367.713071:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8aa93fa79800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045367.713092:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f738a80 x1870706829774720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045367.713106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784045367.713109:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784045367.713111:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045367.713114:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 397 00000100:00080000:2.0:1784045367.713116:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784045367.713119:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8aa941ceb000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045367.713128:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f738e00 x1870706829774848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045367.713191:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829774592:0@lo:400:kworker.0 00000400:00000100:3.0:1784045367.713239:0:3318:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870706829774592 offset 0 length 224: 4 00000100:00100000:3.0:1784045367.713295:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829774720:0@lo:38:kworker.0 00000400:00000100:3.0:1784045367.713313:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706829774720 offset 0 length 520: 4 00000100:00100000:3.0:1784045367.713324:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829774848:0@lo:38:kworker.0 00000400:00000100:3.0:1784045367.713335:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706829774848 offset 0 length 520: 4 00010000:00010000:2.0:1784045368.559416:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784045368.921449:0:13039:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784045368.943537:0:13039:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784045368.943585:0:13039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.943609:0:13039:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.943616:0:13039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.943624:0:13039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.943652:0:13039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045368.943658:0:13039:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784045368.943680:0:13039:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045368.943693:0:13039:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa93f738a80 x1870706829774720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784045382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045368.943717:0:13039:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784045368.943722:0:13039:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784045368.943728:0:13039:0:(import.c:65:import_set_state_nolock()) ffff8aa93fa79800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1784045368.943732:0:13039:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045368.943736:0:13039:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa93f738a80 x1870706829774720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784045382 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045368.943743:0:13039:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784045368.943746:0:13039:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:0.0:1784045368.943775:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829774720:0@lo:38:kworker.0 00010000:00010000:2.0:1784045368.943896:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045368.943968:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045368.943978:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173e00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:2.0:1784045368.943982:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045368.944058:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045368.944066:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045368.944072:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045368.944074:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784045368.944082:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784045368.944130:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045368.944137:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045368.944166:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045368.944174:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2cd06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045368.944185:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045368.944187:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045368.944188:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045368.944198:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045368.944211:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829774976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045368.944275:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045368.944330:0:7497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829774976 00000100:00100000:2.0:1784045368.944337:0:7497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829774976 00000100:00100000:2.0:1784045368.944376:0:7497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045368.944383:0:7497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3318:x1870706829774976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784045368.944389:0:7497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784045368 with bad export cookie 15806332830085204449 00010000:00010000:3.0:1784045368.945651:0:13039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945667:0:13039:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945690:0:13039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945697:0:13039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945774:0:13039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045368.945781:0:13039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945788:0:13039:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945794:0:13039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045368.945800:0:13039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045368.948201:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045368.948216:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045368.948227:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:1.0:1784045368.948232:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045368.948242:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045368.948248:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045368.948253:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784045368.948256:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1784045368.948358:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948366:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045368.948402:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948426:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030c00/0xdb5b5ff6a2d2cd14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cd1b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948443:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045368.948447:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948452:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045368.948455:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948462:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045368.948469:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045368.948474:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784045368.948476:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1784045368.948488:0:5792:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948494:0:5792:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045368.948500:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045368.948523:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045368.948525:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045368.948527:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045368.948811:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829775104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045368.948916:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045368.948969:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045368.948976:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829775232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045368.949010:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045368.949042:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829775104 00000100:00100000:1.0:1784045368.949050:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829775104 00000100:00100000:1.0:1784045368.949092:0:7496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829775232 00000100:00100000:1.0:1784045368.949095:0:7496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829775232 00000100:00100000:1.0:1784045368.949118:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784045368.949125:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1870706829775104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784045368.949131:0:7496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784045368 with bad export cookie 15806332830085204449 00000100:00100000:1.0:1784045368.949173:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1870706829775104:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (257us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784045368.949180:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784045368.949195:0:7496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045368.949199:0:7496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9083e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1870706829775232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784045368.949202:0:7496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784045368 with bad export cookie 15806332830085204449 00000100:00100000:1.0:1784045368.949226:0:7496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9083e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1870706829775232:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (215us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784045368.949231:0:7496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1784045368.949259:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784045368.949263:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8aa907db9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784045368.949266:0:3320:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1784045368.949433:0:13039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784045368.949442:0:13039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173c00/0xdb5b5ff6a2d2cf3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdb5b5ff6a2d2cf44 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045368.949456:0:13039:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1784045368.949462:0:13039:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1784045368.949465:0:13039:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1784045368.949492:0:13039:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1784045368.949496:0:13039:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1784045368.949501:0:13039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1784045368.949767:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784045368.949856:0:13039:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784045368.949860:0:13039:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8aa93b594d40) has no exports 00000020:00080000:3.0:1784045368.949898:0:13039:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8aa93b594d40) has no exports 00000020:01000000:3.0:1784045368.951513:0:13039:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa91255a7e0 - data ffff8aa91df51798/ffff8aa93f772800 00000020:01000000:3.0:1784045368.951665:0:13039:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa905686240 - data ffff8aa933368948/ffff8aa93f8af000 00000100:00080000:1.0:1784045368.971349:0:3320:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.158@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784045368.971354:0:3320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784045368.971362:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa93f739880 x1870706829774592/t0(0) o400->MGC192.168.201.158@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784045383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045368.971430:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa93f73aa00 x1870706829774976/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784045384 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045368.971441:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa937d35c00 x1870706829775104/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784045384 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045368.971467:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa937d34a80 x1870706829775232/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784045384 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784045368.971475:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784045368.971478:0:3320:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784045368.971479:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1784045368.971482:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8aa907db9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045368.971487:0:3320:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 159 00000100:00080000:1.0:1784045368.971496:0:3320:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import ffff8aa907db9800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045368.971666:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937d36a00 x1870706829775360/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045368.971715:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829775104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045368.971740:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3320:1870706829775232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045368.971794:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3317:1870706829775360:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1784045368.971881:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870706829775360 offset 0 length 520: 4 00000100:00100000:3.0:1784045368.975970:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829774592:0@lo:400:kworker.0 00000100:00100000:3.0:1784045368.976005:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3318:1870706829774976:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1784045368.983912:0:7497:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870706829774976 offset 224 length 224: 4 00000100:00100000:2.0:1784045368.983938:0:7497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3318:x1870706829774976:12345-0@lo:103:ldlm_bl.0 Request processed in 39552us (39662us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784045368.983950:0:7497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00100000:10000000:2.0:1784045369.000797:0:13039:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784045369.032522:0:13039:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cb15 00000020:00000080:1.0:1784045369.032532:0:13039:0:(genops.c:906:class_export_put()) final put ffff8aa903657800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784045369.032553:0:13039:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa907eaf000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784045369.032557:0:13039:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa907eaf000 2 00000020:01000004:1.0:1784045369.032560:0:13039:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa907eaf000 from lustre-OST0000 00000020:00000080:1.0:1784045369.032586:0:13039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784045369.032596:0:13039:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1784045369.032599:0:13039:0:(genops.c:906:class_export_put()) final put ffff8aa907e6d800/lustre-OST0000_UUID 00000020:00000080:1.0:1784045369.032602:0:13039:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907e6d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784045369.032608:0:13039:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784045369.032651:0:13039:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1784045369.032656:0:13039:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784045369.032659:0:13039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784045369.032663:0:13039:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784045369.032670:0:13039:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8aa93fa7a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784045369.032676:0:13039:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8aa93b593380) has exports, disconnecting them 00000020:00080000:1.0:1784045369.032679:0:13039:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8aa93fa7a800), last request at 1784045142 00000020:00000080:1.0:1784045369.032683:0:13039:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cb3f 00000020:00080000:1.0:1784045369.032705:0:13039:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa93fa7a800): rc 0 00000020:00000080:1.0:1784045369.032710:0:13039:0:(genops.c:906:class_export_put()) final put ffff8aa93fa7a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784045369.033132:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa903657800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784045369.033146:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93fa7a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784045369.061789:0:13039:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784045369.061799:0:13039:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784045369.061803:0:13039:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784045369.061812:0:13039:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784045369.061869:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa93fa79800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784045369.062192:0:13039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045369.062201:0:13039:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1784045369.062206:0:13039:0:(genops.c:906:class_export_put()) final put ffff8aa93fa7b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1784045369.062211:0:13039:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93fa7b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1784045369.062221:0:13039:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1784045369.062276:0:13039:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa907eaf000 1 00000020:00000080:2.0:1784045369.062282:0:13039:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cacf 00000020:00000080:2.0:1784045369.062288:0:13039:0:(genops.c:906:class_export_put()) final put ffff8aa907e6b800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1784045369.062307:0:13039:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1784045369.062312:0:13039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045369.062317:0:13039:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784045369.062320:0:13039:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8aa907fe8000) has no exports 00000020:00000080:3.0:1784045369.062389:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907e6b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1784045369.112484:0:13039:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045369.112498:0:13039:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1784045369.112503:0:13039:0:(genops.c:906:class_export_put()) final put ffff8aa907ead800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1784045369.112508:0:13039:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907ead800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1784045369.112516:0:13039:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1784045369.112671:0:13039:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8aa907eab800 00000020:02000400:3.0:1784045369.112717:0:13039:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1784045369.570065:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045370.592957:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045371.618143:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784045372.117755:0:13188:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784045372.131810:0:13188:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784045372.131895:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.131908:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.131914:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.131918:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.131933:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784045372.131936:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784045372.131953:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045372.131961:0:13188:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa93f738e00 x1870706829774848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784045382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045372.131972:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784045372.131995:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045372.131998:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1784045372.132002:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829774848:0@lo:38:kworker.0 00000100:00080000:1.0:1784045372.132025:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784045372.132028:0:13188:0:(import.c:65:import_set_state_nolock()) ffff8aa941ceb000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784045372.132032:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045372.132034:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784045372.132036:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784045372.132132:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045372.132141:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132150:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045372.132154:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132163:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045372.132170:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045372.132177:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784045372.132179:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784045372.132182:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784045372.132198:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa907db9800 00010000:00010000:0.0:1784045372.132202:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132221:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030000/0xdb5b5ff6a2d2ccea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2ccf1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132233:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045372.132235:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045372.132237:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045372.132729:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132737:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132741:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132745:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132764:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045372.132768:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132772:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132776:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132779:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045372.132785:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784045372.132787:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784045372.132803:0:13188:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784045372.132806:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1784045372.132809:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:1.0:1784045372.132810:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784045372.132815:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1784045372.132818:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045372.132824:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8aa907fecd40) has no exports 00010000:00010000:0.0:1784045372.132857:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721000 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045372.132861:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132869:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045372.132870:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8aa907fecd40) has no exports 10000000:00010000:0.0:1784045372.132879:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045372.132885:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784045372.132887:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1784045372.132889:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1784045372.132898:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa907db9800 00010000:00010000:0.0:1784045372.132901:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132906:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937721000/0xdb5b5ff6a2d2ccf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2ccff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132929:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045372.132932:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132938:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045372.132941:0:5792:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132947:0:5792:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045372.132953:0:5792:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045372.132958:0:5792:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784045372.132960:0:5792:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784045372.132961:0:5792:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784045372.132967:0:5792:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa907db9800 00010000:00010000:0.0:1784045372.132971:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132977:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa939e33a00/0xdb5b5ff6a2d2cf2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2cf36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045372.132988:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045372.132990:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045372.132992:0:5792:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045372.132999:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784045372.134367:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa91255a420 - data ffff8aa902252360/ffff8aa937d10000 00000020:01000000:1.0:1784045372.134526:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8aa9063286c0 - data ffff8aa90a3501b0/ffff8aa939e17c00 00100000:10000000:1.0:1784045372.149380:0:13188:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784045372.180614:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cbe0 00000020:00000080:3.0:1784045372.180624:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa93b599800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1784045372.180712:0:13188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa93f779800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1784045372.180716:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa93f779800 2 00000020:01000004:3.0:1784045372.180719:0:13188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8aa93f779800 from lustre-OST0001 00000020:00000080:3.0:1784045372.180744:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045372.180753:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1784045372.180756:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa93fa78800/lustre-OST0001_UUID 00000020:00000080:3.0:1784045372.180759:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93fa78800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1784045372.180764:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1784045372.180976:0:13188:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fa48aca7-8b52-46ad-960b-10d4ed6c2d8b->MGS 00010000:00010000:3.0:1784045372.180990:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045372.181015:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045372.181022:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1784045372.181025:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1784045372.181029:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1784045372.181043:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa907db9800 00010000:00010000:3.0:1784045372.181047:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa90148e400/0xdb5b5ff6a2d2caf2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2caf9 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045372.181073:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045372.181079:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045372.181085:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045372.181087:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1784045372.181088:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1784045372.181097:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8aa907db9800 00010000:00010000:3.0:1784045372.181100:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942173a00/0xdb5b5ff6a2d2cd3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdb5b5ff6a2d2cd45 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784045372.181115:0:13188:0:(import.c:65:import_set_state_nolock()) ffff8aa907db9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1784045372.181119:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784045372.181121:0:13188:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784045372.181122:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784045372.181126:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784045372.181137:0:13188:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8aa937d36a00 x1870706829775360/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784045378 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784045372.181232:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784045372.181235:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:0.0:1784045372.181552:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93b599800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1784045372.181790:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fa48aca7-8b52-46ad-960b-10d4ed6c2d8b:3317:1870706829775360:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1784045372.182198:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784045372.182208:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2c9d3 00000020:00000080:3.0:1784045372.182214:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa907e25000/fa48aca7-8b52-46ad-960b-10d4ed6c2d8b 00000020:01000000:3.0:1784045372.182231:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.158@tcp (flags='') 00000020:00000080:3.0:1784045372.182236:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045372.182242:0:13188:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784045372.182246:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8aa907f44d40) has no exports 10000000:01000000:0.0:1784045372.182296:0:5801:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1784045372.182359:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907e25000/fa48aca7-8b52-46ad-960b-10d4ed6c2d8b for MGC192.168.201.158@tcp 10000000:01000000:3.0:1784045372.182406:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.158@tcp: client import never connected 00000100:00080000:3.0:1784045372.182409:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1784045372.182411:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784045372.182413:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1784045372.182415:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784045372.182447:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045372.182452:0:13188:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.158@tcp (uuid fa48aca7-8b52-46ad-960b-10d4ed6c2d8b) 00000020:01000000:3.0:1784045372.182457:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784045372.182460:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045372.182463:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784045372.182467:0:13188:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8aa939db0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784045372.182472:0:13188:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8aa907e90000) has exports, disconnecting them 00000020:00080000:3.0:1784045372.182476:0:13188:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8aa939db0800), last request at 1784045164 00000020:00000080:3.0:1784045372.182480:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cc0a 00000020:00080000:3.0:1784045372.182492:0:13188:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8aa939db0800): rc 0 00000020:00000080:3.0:1784045372.182495:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa939db0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1784045372.184286:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa939db0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1784045372.184552:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa907db9800 for MGC192.168.201.158@tcp 00000020:00000080:0.0:1784045372.184559:0:37:0:(genops.c:906:class_export_put()) final put ffff8aa9084da000/fa48aca7-8b52-46ad-960b-10d4ed6c2d8b 00000020:00000080:0.0:1784045372.184562:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa9084da000/fa48aca7-8b52-46ad-960b-10d4ed6c2d8b for MGC192.168.201.158@tcp 00000020:01000000:0.0:1784045372.184567:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.158@tcp (fa48aca7-8b52-46ad-960b-10d4ed6c2d8b) 00010000:01000000:3.0:1784045372.192984:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784045372.192993:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045372.192997:0:13188:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784045372.193004:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784045372.193145:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8aa941ceb000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1784045372.193205:0:5792:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1784045372.193651:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1784045372.194100:0:5787:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8aa9100c5e00:5787] 0 exiting: rc = 1 00000100:00100000:0.0:1784045372.194176:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8aa9100c5c00:5788] 1 exiting: rc = 0 00000100:00100000:3.0:1784045372.194246:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.194480:0:7496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8aa92cef2e00:7496] 3 exiting: rc = 0 00000100:00100000:0.0:1784045372.194570:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8aa906bd8000:5789] 0 exiting: rc = 1 00000100:00100000:0.0:1784045372.194620:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8aa907f68800:5790] 1 exiting: rc = 0 00000100:00100000:0.0:1784045372.194654:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8aa906bd9000:5791] 2 exiting: rc = 0 00000100:00100000:3.0:1784045372.195115:0:7497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8aa941cd4600:7497] 4 exiting: rc = 0 00000100:00100000:1.0:1784045372.195290:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195296:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195299:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195303:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195307:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195311:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195314:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195319:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195323:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195327:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195331:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195336:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195343:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195349:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195355:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195360:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195367:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195373:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195378:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195383:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195389:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195394:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195399:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195415:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195422:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195427:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195432:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195438:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195444:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195450:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195454:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195459:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195465:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195470:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195475:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195480:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195485:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195491:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195496:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195501:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195506:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195511:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195516:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195521:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195525:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195530:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195536:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195541:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195546:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195551:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195556:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195561:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195566:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195570:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195575:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195580:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195586:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195591:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195601:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195604:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195608:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195611:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195614:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.195617:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784045372.196339:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784045372.196348:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1784045372.196354:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa939d5b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1784045372.196359:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa939d5b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1784045372.196364:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1784045372.196403:0:13188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa93f779800 1 00000020:00000080:1.0:1784045372.196409:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdb5b5ff6a2d2cbaf 00000020:00000080:1.0:1784045372.196415:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa93b59a800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1784045372.196463:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1784045372.196468:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784045372.196473:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784045372.196476:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8aa9101499c0) has no exports 00000020:00000080:0.0:1784045372.197644:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa93b59a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784045372.207720:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045372.207733:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784045372.207738:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa907e6a000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784045372.207741:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907e6a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784045372.207750:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784045372.207984:0:13188:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8aa907e6c800 00000020:01000000:0.0:1784045372.208002:0:13188:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784045372.208005:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045372.208008:0:13188:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784045372.208011:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8aa93b590000) has no exports 00000020:00000080:0.0:1784045372.208043:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045372.208049:0:13188:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784045372.208051:0:13188:0:(genops.c:906:class_export_put()) final put ffff8aa907e68000/OSS_uuid 00000020:00000080:0.0:1784045372.208064:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff8aa907e68000/OSS_uuid for OSS 00000020:01000000:0.0:1784045372.208068:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1784045372.208159:0:5800:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1784045372.210006:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8aa90600ec00:6599] 1 exiting: rc = 0 00000100:00100000:2.0:1784045372.210091:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8aa906952600:6598] 0 exiting: rc = 1 00000100:00100000:2.0:1784045372.210136:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8aa906970a00:6600] 2 exiting: rc = 0 00000100:00100000:2.0:1784045372.210179:0:8930:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8aa93f82f800:8930] 3 exiting: rc = 0 00000100:00100000:0.0:1784045372.210645:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210661:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210665:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210669:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210673:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210679:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210692:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210696:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210699:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210703:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210707:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210710:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210714:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210717:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210721:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210724:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210727:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210731:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210734:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210737:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210741:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210744:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210747:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210750:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210753:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210756:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210759:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210762:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210765:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210769:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210771:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210774:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210777:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210781:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210784:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210787:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210795:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210798:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210802:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210806:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210809:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210814:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210819:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.210824:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.211084:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.211093:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.211100:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.211105:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.211109:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213097:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213119:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213126:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213132:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213138:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213144:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213149:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213154:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213160:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213166:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213172:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213177:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213182:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213187:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045372.213192:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.218718:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8aa90600ea00:6602] 1 exiting: rc = 0 00000100:00100000:0.0:1784045372.222445:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8aa906970c00:6601] 0 exiting: rc = 1 00000100:00100000:3.0:1784045372.222614:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222627:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222633:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222637:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222642:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222648:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222653:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222658:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222662:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222667:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222671:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222676:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222680:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222685:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222690:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222695:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222701:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222707:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222712:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222717:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222722:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222727:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222732:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222737:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222742:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222747:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222753:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222758:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222764:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222769:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222774:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222777:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222796:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222800:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222803:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222807:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222811:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222860:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222865:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222868:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222872:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222876:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222879:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222882:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222885:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222889:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222892:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222894:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222897:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222900:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222903:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222906:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222909:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222912:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222915:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222918:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222921:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222924:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222927:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222930:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222933:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222936:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222939:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.222942:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.223724:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8aa906952c00:6603] 0 exiting: rc = 1 00000100:00100000:0.0:1784045372.224211:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8aa906953400:6605] 2 exiting: rc = 0 00000100:00100000:1.0:1784045372.224541:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8aa906953a00:6604] 1 exiting: rc = 0 00000100:00100000:3.0:1784045372.224707:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224715:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224733:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224740:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224746:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224752:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224758:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224764:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224770:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224775:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224780:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224786:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224791:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224797:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224803:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224808:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224814:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224818:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224824:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224890:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224897:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224903:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224909:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224914:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224919:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224924:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224929:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224950:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224957:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224962:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224969:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224974:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224979:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224985:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224989:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.224996:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225001:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225013:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225020:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225028:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225034:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225039:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225044:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225049:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225065:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225071:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225076:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225081:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225086:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225092:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225098:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225118:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225126:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225132:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225137:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225143:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225149:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225155:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225160:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225167:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225172:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225177:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225183:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.225196:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045372.242451:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8aa906952800:6607] 1 exiting: rc = 0 00000100:00100000:2.0:1784045372.243042:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8aa906953200:6606] 0 exiting: rc = 1 00000100:00100000:3.0:1784045372.243205:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243213:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243219:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243223:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243229:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243233:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243238:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243242:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243260:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243265:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243271:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243276:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243280:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243286:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243291:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243296:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243301:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243306:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243311:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243316:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243322:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243327:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243332:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243338:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243343:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243348:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243353:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243359:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243363:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243368:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243373:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243378:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243382:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243387:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243392:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243396:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243401:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243406:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243411:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243417:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243422:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243428:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243432:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243444:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243449:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243455:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243459:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243464:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243469:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243474:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243479:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243484:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243488:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243493:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243497:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243502:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243507:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243512:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243516:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243522:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243527:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243533:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243538:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.243544:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244419:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8aa90ab7c000:6609] 1 exiting: rc = 0 00000100:00100000:2.0:1784045372.244599:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8aa90ab7ce00:6608] 0 exiting: rc = 1 00000100:00100000:3.0:1784045372.244677:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244685:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244692:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244698:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244704:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244710:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244724:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244731:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244737:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244743:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244750:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244756:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244762:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244775:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244781:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244786:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244792:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.244798:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245188:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245196:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245202:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245208:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245214:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245220:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245226:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245231:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245238:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245242:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245248:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245254:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245273:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245281:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245287:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245293:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245299:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245305:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245310:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245316:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245323:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245329:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245336:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245342:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245362:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245370:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245376:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245382:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245388:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245395:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245410:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245416:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245423:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245429:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245434:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245441:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245462:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245469:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245474:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245481:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245487:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245492:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245498:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245505:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245511:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045372.245517:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1784045372.263374:0:13188:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1784045387.687366:0:13805:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784045396.459409:0:14218:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784045396.459414:0:14218:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784045396.459515:0:14218:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8aa939d58800 00000020:01000004:3.0:1784045396.459530:0:14218:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784045396.459538:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784045396.459552:0:14218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8aa907fecd40) 00000020:00000080:3.0:1784045396.459566:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784045396.473308:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784045396.476525:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1784045396.476998:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784045396.477070:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 331: rc = 0 00100000:10000000:2.0:1784045396.477175:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 331: rc = 0 00100000:10000000:2.0:1784045396.477274:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 331: rc = 0 00100000:10000000:2.0:1784045396.477365:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 331: rc = 0 00100000:10000000:2.0:1784045396.477462:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 331: rc = 0 00100000:10000000:2.0:1784045396.477560:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 331: rc = 0 00100000:10000000:2.0:1784045396.477852:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 333: rc = 0 00100000:10000000:2.0:1784045396.484811:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 416: rc = 0 00100000:10000000:2.0:1784045396.484942:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 416: rc = 0 00100000:10000000:2.0:1784045396.486329:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 636: rc = 0 00100000:10000000:2.0:1784045396.486770:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 636: rc = 0 00100000:10000000:2.0:1784045396.487289:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 636: rc = 0 00100000:10000000:2.0:1784045396.487716:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 636: rc = 0 00100000:10000000:2.0:1784045396.488038:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 636: rc = 0 00100000:10000000:2.0:1784045396.490027:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 636: rc = 0 00100000:10000000:2.0:1784045396.490300:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 636: rc = 0 00100000:10000000:2.0:1784045396.490827:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 636: rc = 0 00100000:10000000:2.0:1784045396.491710:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 636: rc = 0 00100000:10000000:2.0:1784045396.494146:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 636: rc = 0 00100000:10000000:2.0:1784045396.494914:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 636: rc = 0 00100000:10000000:2.0:1784045396.495222:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 636: rc = 0 00100000:10000000:2.0:1784045396.495909:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 244: rc = 0 00100000:10000000:2.0:1784045396.497699:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 244: rc = 0 00100000:10000000:2.0:1784045396.498051:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 244: rc = 0 00100000:10000000:2.0:1784045396.498307:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 244: rc = 0 00100000:10000000:2.0:1784045396.498760:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 244: rc = 0 00100000:10000000:2.0:1784045396.499082:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 244: rc = 0 00100000:10000000:2.0:1784045396.499327:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 244: rc = 0 00100000:10000000:2.0:1784045396.500200:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 244: rc = 0 00100000:10000000:2.0:1784045396.500600:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 244: rc = 0 00100000:10000000:2.0:1784045396.500918:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 244: rc = 0 00100000:10000000:2.0:1784045396.503543:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 244: rc = 0 00100000:10000000:2.0:1784045396.503956:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 244: rc = 0 00100000:10000000:2.0:1784045396.504538:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 244: rc = 0 00100000:10000000:2.0:1784045396.504805:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 244: rc = 0 00100000:10000000:2.0:1784045396.505670:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 244: rc = 0 00100000:10000000:2.0:1784045396.505943:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 244: rc = 0 00100000:10000000:2.0:1784045396.506603:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 244: rc = 0 00100000:10000000:2.0:1784045396.506919:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 244: rc = 0 00100000:10000000:3.0:1784045396.508485:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 244: rc = 0 00100000:10000000:3.0:1784045396.508765:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 244: rc = 0 00100000:10000000:3.0:1784045396.509273:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 244: rc = 0 00100000:10000000:3.0:1784045396.509750:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 244: rc = 0 00100000:10000000:3.0:1784045396.510026:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 244: rc = 0 00100000:10000000:3.0:1784045396.511026:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 244: rc = 0 00100000:10000000:3.0:1784045396.511309:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 244: rc = 0 00100000:10000000:3.0:1784045396.511655:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 244: rc = 0 00100000:10000000:3.0:1784045396.511939:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 244: rc = 0 00100000:10000000:3.0:1784045396.512178:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 244: rc = 0 00100000:10000000:3.0:1784045396.512430:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 244: rc = 0 00100000:10000000:3.0:1784045396.513581:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 244: rc = 0 00100000:10000000:3.0:1784045396.513953:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 244: rc = 0 00100000:10000000:3.0:1784045396.514589:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 244: rc = 0 00100000:10000000:3.0:1784045396.515986:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 650: rc = 0 00100000:10000000:3.0:1784045396.517035:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1784045396.517812:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 351: rc = 0 00100000:10000000:3.0:1784045396.518280:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1784045396.518464:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 351: rc = 0 00100000:10000000:3.0:1784045396.518678:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1784045396.518746:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 351: rc = 0 00100000:10000000:3.0:1784045396.519632:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1784045396.519714:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 417: rc = 0 00100000:10000000:3.0:1784045396.519909:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1784045396.521563:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 417: rc = 0 00100000:10000000:3.0:1784045396.521863:0:14218:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1784045396.521934:0:14218:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 417: rc = 0 00000020:00000080:3.0:1784045396.522391:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784045396.522398:0:14218:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784045396.522409:0:14218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dcd4 00000020:01000004:3.0:1784045396.522416:0:14218:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784045396.522421:0:14218:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784045396.522426:0:14218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa939d58800 from MGS 00000020:01000004:3.0:1784045396.522429:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784045396.522438:0:14218:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8aa907fe8000) 00000020:00000080:3.0:1784045396.522457:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784045396.522507:0:14218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa939d58800 from MGS, refs=2 00080000:01000000:3.0:1784045396.522512:0:14218:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045396.522518:0:14218:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dce2 00000100:00100000:3.0:1784045396.522611:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784045396.522764:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784045396.522771:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784045396.524116:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784045396.524127:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784045396.525046:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045396.525564:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784045396.525570:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784045396.526712:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784045396.526793:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784045396.527162:0:14218:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784045396.527169:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784045396.528647:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045396.528652:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045396.528654:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045396.529001:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045396.529003:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045396.529005:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045396.530138:0:14218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784045396.537578:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784045396.553043:0:14218:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784045396.553073:0:14218:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784045396.553077:0:14218:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784045396.556817:0:14227:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784045396.557087:0:14218:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784045396.557573:0:14218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784045396.558127:0:14218:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784045396.558890:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045396.559039:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784045396.559046:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784045396.563703:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784045396.563719:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784045396.564337:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784045396.564345:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784045396.565025:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784045396.565045:0:14218:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.158@tcp' 00000020:01000004:3.0:1784045396.565047:0:14218:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784045396.565075:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.158@tcp (typ=mgc) 00000020:00000080:3.0:1784045396.565087:0:14218:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.158@tcp (ffff8aa907feb380) 00000020:00000080:3.0:1784045396.565102:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784045396.565178:0:14218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa9391d4000@MGC192.168.201.158@tcp: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1784045396.565326:0:14218:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.158@tcp-0 is initialized 00000040:01000000:3.0:1784045396.565332:0:14218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 1 is initialized 10000000:01000000:1.0:1784045396.578670:0:14233:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784045396.578912:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.158@tcp (uuid ecfa0ba9-cdb8-42f8-923d-132e8368012c) 00000020:00000080:2.0:1784045396.578940:0:14218:0:(genops.c:1406:class_connect()) connect: client ecfa0ba9-cdb8-42f8-923d-132e8368012c, cookie 0xdb5b5ff6a2d2dcf0 00000100:00080000:2.0:1784045396.578953:0:14218:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045396.578959:0:14218:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import ffff8aa9391d4000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045396.578994:0:14218:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f73a680 x1870706829775488/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045396.579020:0:14218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ecfa0ba9-cdb8-42f8-923d-132e8368012c->MGS 00000020:01000004:2.0:1784045396.579041:0:14218:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784045396.579123:0:14218:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784045396.579138:0:14218:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8aa910148000) 00000020:00000080:2.0:1784045396.579150:0:14218:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784045396.579857:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3317:1870706829775488:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784045396.579926:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045396.580003:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829775488 00000100:00100000:1.0:1784045396.580011:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829775488 00000100:00100000:1.0:1784045396.580045:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045396.580063:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3317:x1870706829775488:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784045396.580085:0:14229:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from ecfa0ba9-cdb8-42f8-923d-132e8368012c@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:1.0:1784045396.580108:0:14229:0:(genops.c:1406:class_connect()) connect: client ecfa0ba9-cdb8-42f8-923d-132e8368012c, cookie 0xdb5b5ff6a2d2dcfe 00000100:00080000:1.0:1784045396.580884:0:14229:0:(import.c:65:import_set_state_nolock()) ffff8aa93f764800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045396.580950:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+5:3317:x1870706829775488:12345-0@lo:250:mount.lustre.0 Request processed in 885us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.580958:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045396.581000:0:3317:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1784045396.581008:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.158@tcp: connect to target with instance 0 00000100:00080000:1.0:1784045396.581016:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784045396.581021:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784045396.581024:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa9391d4000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784045396.581026:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784045396.581036:0:3317:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784045396.581041:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3317:1870706829775488:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1784045396.582164:0:14232:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1784045396.601618:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045396.601969:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784045396.601978:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784045396.604118:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045396.604132:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784045396.604698:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784045396.604705:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784045396.606266:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045396.606575:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784045396.606582:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784045396.607360:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784045396.607368:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784045396.656278:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045396.656589:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784045396.656596:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784045396.657670:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784045396.657679:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1784045396.658335:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045396.658595:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784045396.658600:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784045396.659034:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045396.659040:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784045396.659617:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045396.659772:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784045396.659777:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784045396.660630:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045396.660652:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784045396.661466:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045396.661618:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784045396.661622:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784045396.662210:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045396.662217:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784045396.683939:0:14218:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045396.684176:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784045396.684185:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784045396.688102:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784045396.688119:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784045396.690018:0:14218:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784045396.690034:0:14218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784045396.696025:0:14218:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784045396.696051:0:14218:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784045396.696056:0:14218:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784045396.696224:0:14218:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784045396.696258:0:14218:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784045396.696263:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784045396.696264:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784045396.696266:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045396.696267:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045396.696268:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045396.696269:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045396.696271:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045396.696272:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784045396.696274:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045396.696275:0:14218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045396.696278:0:14218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784045396.696280:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045396.696281:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784045396.696282:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045396.696283:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045396.696284:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045396.696286:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045396.696287:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045396.696288:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784045396.696289:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045396.696290:0:14218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045396.696317:0:14218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784045396.696585:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829775616:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784045396.696690:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045396.696747:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.697950:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829775616 00000100:00100000:1.0:1784045396.697964:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829775616 00000100:00100000:1.0:1784045396.698017:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045396.698026:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+5:14218:x1870706829775616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784045396.698086:0:14231:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784045396.698090:0:14231:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784045396.698093:0:14231:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1784045396.698556:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784045396.698995:0:14231:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1784045396.704115:0:14253:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784045396.704123:0:14253:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784045396.704127:0:14253:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784045396.704162:0:14253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1784045396.704475:0:14231:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784045396.704486:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784045396.724682:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+5:14218:x1870706829775616:12345-0@lo:253:mount.lustre.0 Request processed in 26647us (27983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.724697:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045396.725221:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829775616:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784045396.725239:0:14218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784045396.725243:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045396.725244:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784045396.725261:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045396.725263:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045396.725264:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045396.725265:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045396.725266:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045396.725268:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784045396.725269:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045396.725270:0:14218:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784045396.725290:0:14218:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa939d58800 from lustre-MDT0000 10000000:01000000:3.0:1784045396.725317:0:14218:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784045396.725319:0:14218:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784045396.725323:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8aa907feb380 10000000:01000000:3.0:1784045396.725327:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045396.725336:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8aa907feb380 from 1 10000000:01000000:3.0:1784045396.725339:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784045396.725391:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.725404:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.725414:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045396.725447:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829775744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045396.725490:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045396.725536:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.725675:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829775744 00000100:00100000:1.0:1784045396.725682:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829775744 00000100:00100000:1.0:1784045396.725730:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045396.725740:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+5:14218:x1870706829775744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045396.725753:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045396.725767:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2dd0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2dd05 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.725789:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2dd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd05 expref: 6 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.725800:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa92d361800/0xdb5b5ff6a2d2dd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd05 expref: 6 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.725810:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d361800, rc 0) 00000100:00100000:1.0:1784045396.725883:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+6:14218:x1870706829775744:12345-0@lo:101:mount.lustre.0 Request processed in 145us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.725900:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045396.725996:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829775744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045396.726012:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.726020:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045396.726082:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829775872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.726111:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.726140:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91141dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045396.726310:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829775872 00000100:00100000:3.0:1784045396.726315:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829775872 00000100:00100000:3.0:1784045396.726356:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045396.726363:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+6:14218:x1870706829775872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045396.726806:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+6:14218:x1870706829775872:12345-0@lo:501:mount.lustre.0 Request processed in 443us (693us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045396.726820:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045396.726921:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829775872:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784045396.726950:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784045396.726972:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.726981:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045396.726989:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa939d58800 10000000:01000000:2.0:1784045396.726995:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784045396.726998:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8aa939d58800 10000000:01000000:2.0:1784045396.727001:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784045396.727004:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8aa939d58800 from 1 10000000:01000000:2.0:1784045396.727006:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784045396.727029:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727037:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727045:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045396.727063:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784045396.727098:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.727123:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa91141dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045396.727142:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829776000 00000100:00100000:2.0:1784045396.727146:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829776000 00000100:00100000:2.0:1784045396.727171:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045396.727176:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+6:14218:x1870706829776000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045396.727187:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045396.727201:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721000/0xdb5b5ff6a2d2dd1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2dd13 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727220:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721000/0xdb5b5ff6a2d2dd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd13 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727229:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721000/0xdb5b5ff6a2d2dd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd13 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727237:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721000, rc 0) 00000100:00100000:2.0:1784045396.727266:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+7:14218:x1870706829776000:12345-0@lo:101:mount.lustre.0 Request processed in 89us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045396.727271:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045396.727304:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045396.727316:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd1a expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727324:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2dd1a expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045396.727336:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784045396.727356:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd1a expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727363:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721200/0xdb5b5ff6a2d2dd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd1a expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045396.727369:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784045396.727373:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784045396.727376:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8aa939d58800 10000000:01000000:2.0:1784045396.727379:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784045396.727382:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784045396.727384:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784045396.727397:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727403:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.727409:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045396.727421:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784045396.727619:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.727650:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90884bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045396.727708:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829776128 00000100:00100000:0.0:1784045396.727712:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829776128 00000100:00100000:0.0:1784045396.727739:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045396.727745:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+7:14218:x1870706829776128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045396.727753:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045396.727763:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2dd28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2dd21 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.727776:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2dd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd21 expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.727783:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e33000/0xdb5b5ff6a2d2dd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd21 expref: 8 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.727791:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33000, rc 0) 00000100:00100000:0.0:1784045396.727857:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+8:14218:x1870706829776128:12345-0@lo:101:mount.lustre.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.727864:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045396.728208:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045396.728219:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd28 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.728227:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2dd28 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045396.728285:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.728311:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.728341:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90884bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045396.728457:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829776256 00000100:00100000:0.0:1784045396.728461:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829776256 00000100:00100000:0.0:1784045396.728493:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045396.728500:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+8:14218:x1870706829776256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045396.730271:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14218:x1870706829776256:12345-0@lo:501:mount.lustre.0 Request processed in 1765us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.730283:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045396.730609:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.730670:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045396.730719:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.730813:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90884bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.735271:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829776384 00000100:00100000:1.0:1784045396.735287:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829776384 00000100:00100000:1.0:1784045396.736538:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045396.736558:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14218:x1870706829776384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045396.737073:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14218:x1870706829776384:12345-0@lo:503:mount.lustre.0 Request processed in 522us (6352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.737082:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045396.737211:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829776384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045396.738057:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14254:1870706829776512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045396.738116:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045396.738159:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045396.738215:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829776512 00000100:00100000:0.0:1784045396.738221:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829776512 00000100:00100000:0.0:1784045396.738262:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045396.738271:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14254:x1870706829776512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045396.738658:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14254:x1870706829776512:12345-0@lo:502:llog_process_th.0 Request processed in 388us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.738673:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045396.738862:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14254:1870706829776512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045396.738895:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045396.738907:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.738909:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784045396.738918:0:14254:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784045396.738921:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045396.738934:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8aa91014cd40) 00000020:00000080:2.0:1784045396.738950:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784045396.738955:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784045396.739017:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784045396.739024:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dd36 00000020:00000080:2.0:1784045396.739232:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784045396.739236:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045396.739240:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.739241:0:14254:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784045396.739244:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045396.739247:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.739248:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784045396.739258:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045396.739265:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8aa91014b380) 00000020:00000080:2.0:1784045396.739276:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784045396.739280:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784045396.739282:0:14254:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784045396.739285:0:14254:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784045396.739290:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784045396.739337:0:14254:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa939d58800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784045396.739367:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8aa9101499c0) 00000020:00000080:2.0:1784045396.739376:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784045396.739420:0:14254:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784045396.739426:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2dd4b 00000020:00000080:2.0:1784045396.739521:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784045396.739527:0:14254:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784045396.739532:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdb5b5ff6a2d2dd52 00080000:01000000:2.0:1784045396.739536:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784045396.739540:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dd59 00010000:00010000:3.0:1784045396.838997:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1784045396.840175:0:14254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1784045396.840413:0:14254:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784045396.840979:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8aa907fe99c0) 00000020:00000080:3.0:1784045396.841003:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784045396.841065:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784045396.841073:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dd67 00000020:00000080:3.0:1784045396.841900:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784045396.854993:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdb5b5ff6a2d2dd6e 00000020:00000080:3.0:1784045396.856481:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784045396.856496:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045396.856504:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.856505:0:14254:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784045396.856509:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784045396.856512:0:14254:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784045396.856513:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045396.856515:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045396.856516:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784045396.856518:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.856520:0:14254:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784045396.856522:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045396.856526:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.856528:0:14254:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784045396.856532:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784045396.856576:0:14254:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784045396.856594:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045396.856598:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.856605:0:14254:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784045396.856609:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784045396.856613:0:14254:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784045396.856616:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.856617:0:14254:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784045396.856620:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784045396.856625:0:14254:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:3.0:1784045396.856661:0:14254:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784045396.856664:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045396.856681:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8aa907f44d40) 00000020:00000080:3.0:1784045396.856697:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1784045396.856702:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784045396.856774:0:14254:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784045396.856780:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784045396.856786:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dd7c 00010000:00080000:3.0:1784045396.856818:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa904d8d000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1784045396.857070:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1784045396.857457:0:14254:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784045396.857502:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784045396.858429:0:14254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045396.858502:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1784045396.858570:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1784045396.862088:0:14258:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045396.862097:0:14258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784045396.863789:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784045396.863806:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784045396.863899:0:14254:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784045396.863920:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2dd83 00000100:00080000:1.0:1784045396.863931:0:14254:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784045396.863937:0:14254:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa904d8d000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1784045396.863973:0:14254:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa92d02d500 x1870706829776640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045396.864005:0:14254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784045396.864055:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045396.864059:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045396.864061:0:14254:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784045396.864064:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784045396.864066:0:14254:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784045396.864068:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784045396.864069:0:14254:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784045396.864070:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784045396.864073:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045396.864074:0:14254:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784045396.864085:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784045396.864089:0:14254:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784045396.864093:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045396.864094:0:14254:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784045396.864096:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784045396.864100:0:14254:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1784045396.864125:0:14254:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784045396.864128:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784045396.864139:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8aa907e90000) 00000020:00000080:1.0:1784045396.864153:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784045396.864158:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784045396.864215:0:14254:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784045396.864221:0:14254:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784045396.864226:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdb5b5ff6a2d2dd91 00010000:00080000:1.0:1784045396.864256:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa93f7c5000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784045396.865818:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1784045396.866042:0:14254:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784045396.866063:0:14254:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784045396.866492:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829776640:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784045396.866562:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706829776640 offset 0 length 520: 4 00000040:00080000:1.0:1784045396.868826:0:14254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045396.869689:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784045396.869799:0:14254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1784045396.878236:0:14260:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784045396.878247:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784045396.883099:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784045396.883114:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784045396.883149:0:14254:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784045396.883167:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2dd98 00000100:00080000:3.0:1784045396.883183:0:14254:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045396.883188:0:14254:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa93f7c5000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1784045396.883223:0:14254:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa939f4ce00 x1870706829776768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045396.883249:0:14254:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784045396.883305:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045396.883309:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.883311:0:14254:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784045396.883314:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045396.883319:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.883321:0:14254:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784045396.883323:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784045396.883326:0:14254:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784045396.883328:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045396.883330:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.883332:0:14254:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784045396.883335:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045396.883338:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045396.883339:0:14254:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784045396.883343:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784045396.883379:0:14254:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14254:1870706829776896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045396.883547:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829776768:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1784045396.885806:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706829776768 offset 0 length 520: 4 00000100:00100000:3.0:1784045396.886551:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.887547:0:14254:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908289600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045396.888871:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829776896 00000100:00100000:0.0:1784045396.888884:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829776896 00000100:00100000:0.0:1784045396.888947:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045396.888958:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14254:x1870706829776896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045396.889700:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14254:x1870706829776896:12345-0@lo:502:llog_process_th.0 Request processed in 742us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.889711:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045396.892728:0:14254:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14254:1870706829776896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045396.892780:0:14254:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045396.892791:0:14254:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.892793:0:14254:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784045396.892797:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1784045396.895740:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1784045396.895780:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784045396.895853:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd28 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.895866:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721400/0xdb5b5ff6a2d2dd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd28 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045396.895874:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa939d58800 from 1 10000000:01000000:0.0:1784045396.895877:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784045396.895921:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.895930:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.895940:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045396.895968:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045396.896050:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045396.896090:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa33d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.897057:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777024 00000100:00100000:1.0:1784045396.897069:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777024 00000100:00100000:1.0:1784045396.897119:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045396.897128:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+9:14218:x1870706829777024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045396.897143:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045396.897168:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2dd9f expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.897193:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 10 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.897204:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 10 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.897213:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa92d360400, rc 0) 00000100:00100000:1.0:1784045396.897270:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+10:14218:x1870706829777024:12345-0@lo:101:mount.lustre.0 Request processed in 142us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.897277:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045396.897689:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045396.897706:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.897716:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045396.898256:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777152:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784045396.898304:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045396.898395:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa33d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045396.904573:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777152 00000100:00100000:3.0:1784045396.904587:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777152 00000100:00100000:3.0:1784045396.904665:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045396.904677:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+10:14218:x1870706829777152:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784045396.904703:0:14230:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784045396.904710:0:14230:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784045396.904864:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+10:14218:x1870706829777152:12345-0@lo:256:mount.lustre.0 Request processed in 189us (6558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.904888:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045396.905033:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777152:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784045396.905683:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045396.905708:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.905722:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045396.905780:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa939d58800 from 1 10000000:01000000:2.0:1784045396.905783:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045396.905822:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.905872:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.905882:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045396.905906:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784045396.905956:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.905992:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045396.907770:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777280 00000100:00100000:3.0:1784045396.907783:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777280 00000100:00100000:3.0:1784045396.907865:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045396.907876:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+10:14218:x1870706829777280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045396.907890:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045396.907912:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ddad expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.907938:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.907948:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.907958:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045e00, rc 0) 00000100:00100000:3.0:1784045396.908025:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829777280:12345-0@lo:101:mount.lustre.0 Request processed in 151us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.908032:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045396.909606:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045396.909645:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.909658:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045396.909738:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.909788:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.909818:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045396.909917:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777408 00000100:00100000:0.0:1784045396.909923:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777408 00000100:00100000:0.0:1784045396.909965:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045396.909974:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829777408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045396.910369:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829777408:12345-0@lo:501:mount.lustre.0 Request processed in 395us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.910377:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045396.910719:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.910753:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045396.910799:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.910864:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045396.910937:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777536 00000100:00100000:0.0:1784045396.910942:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777536 00000100:00100000:0.0:1784045396.910976:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045396.910983:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829777536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045396.911181:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829777536:12345-0@lo:503:mount.lustre.0 Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.911188:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784045396.914056:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045396.929171:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14262:1870706829777664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045396.929264:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.929313:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9344ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045396.929397:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777664 00000100:00100000:3.0:1784045396.929405:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777664 00000100:00100000:3.0:1784045396.929601:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784045396.929612:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14262:x1870706829777664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045396.929928:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14262:x1870706829777664:12345-0@lo:502:llog_process_th.0 Request processed in 317us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.929946:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784045396.930078:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14262:1870706829777664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045396.930108:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045396.930118:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.930121:0:14262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784045396.930127:0:14262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa939d58800 00000020:00000080:2.0:1784045396.930130:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045396.930138:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045396.930141:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.930143:0:14262:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784045396.930145:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045396.930148:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.930149:0:14262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784045396.930153:0:14262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa939d58800 00000020:00000080:2.0:1784045396.930155:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045396.930224:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045396.930228:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.930229:0:14262:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784045396.930231:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045396.930234:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.930236:0:14262:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784045396.930239:0:14262:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa939d58800 00000020:00000080:2.0:1784045396.930241:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784045396.930279:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14262:1870706829777792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045396.930318:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.930345:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777792 00000100:00100000:2.0:1784045396.930354:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777792 00000100:00100000:2.0:1784045396.930380:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045396.930386:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14262:x1870706829777792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045396.930799:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14262:x1870706829777792:12345-0@lo:502:llog_process_th.0 Request processed in 412us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045396.930806:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045396.931990:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045396.932020:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14262:1870706829777792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045396.932054:0:14262:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045396.932060:0:14262:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045396.932062:0:14262:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784045396.932066:0:14262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784045396.932548:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1784045396.932572:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045396.932596:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.932608:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045396.932660:0:14218:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784045396.932664:0:14218:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa939d58800 10000000:01000000:0.0:1784045396.932668:0:14218:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa939d58800 10000000:01000000:0.0:1784045396.932673:0:14218:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045396.932679:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa939d58800 from 1 10000000:01000000:0.0:1784045396.932681:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784045396.932714:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.932723:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.932732:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045396.932756:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045396.932813:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045396.932863:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa33180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045396.933731:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829777920 00000100:00100000:2.0:1784045396.933741:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829777920 00000100:00100000:2.0:1784045396.933790:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045396.933799:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829777920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045396.933813:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045396.933847:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2ddc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ddbb expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.933873:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2ddc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddbb expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.933884:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721c00/0xdb5b5ff6a2d2ddc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddbb expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.933892:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721c00, rc 0) 00000100:00100000:2.0:1784045396.933945:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14218:x1870706829777920:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045396.933959:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045396.934061:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829777920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045396.934076:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ddc2 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.934096:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2ddc2 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045396.934155:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829778048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045396.934186:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045396.934216:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa33180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045396.934394:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778048 00000100:00100000:2.0:1784045396.934398:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778048 00000100:00100000:2.0:1784045396.934422:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784045396.939511:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14218:x1870706829778048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.939894:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14218:x1870706829778048:12345-0@lo:501:mount.lustre.0 Request processed in 5464us (5705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045396.939903:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784045396.939984:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829778048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045396.940037:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829778176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045396.940083:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.940114:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e59180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045396.940130:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778176 00000100:00100000:2.0:1784045396.940136:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778176 00000100:00100000:2.0:1784045396.940169:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045396.940176:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14218:x1870706829778176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045396.940311:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14218:x1870706829778176:12345-0@lo:503:mount.lustre.0 Request processed in 135us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045396.940317:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045396.940369:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829778176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045396.940548:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14264:1870706829778304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045396.940582:0:14264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.940601:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778304 00000100:00100000:2.0:1784045396.940605:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778304 00000100:00100000:2.0:1784045396.940645:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045396.940653:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14264:x1870706829778304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045396.940800:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14264:x1870706829778304:12345-0@lo:502:llog_process_th.0 Request processed in 148us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045396.940807:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045396.940866:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045396.940878:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14264:1870706829778304:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784045396.940927:0:14264:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784045396.940942:0:14264:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8aa93b590000) 00000020:00000080:2.0:1784045396.940962:0:14264:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1784045396.941095:0:14264:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa939d58800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784045396.941099:0:14264:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa939d58800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784045396.941102:0:14264:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa939d58800 4 00010000:00080000:2.0:1784045396.941137:0:14264:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa93b59c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:2.0:1784045396.953415:0:14264:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1784045396.953536:0:14264:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784045396.953578:0:14264:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784045396.953593:0:14264:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdb5b5ff6a2d2ddd0 00000100:00080000:2.0:1784045396.953605:0:14264:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045396.953612:0:14264:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8aa93b59c800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045396.953658:0:14264:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f73b800 x1870706829778432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045396.953689:0:14264:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784045396.959594:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829778432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784045396.964948:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045396.965038:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778432 00000100:00100000:1.0:1784045396.965047:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778432 00000100:00100000:1.0:1784045396.965084:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045396.965092:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1870706829778432:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784045396.965149:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1870706829778432:12345-0@lo:38:llog_process_th.0 Request processed in 56us (208us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784045396.965156:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045396.965196:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045396.965204:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93b59c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045396.965208:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784045396.965212:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829778432:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784045396.966279:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14264:1870706829778560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045396.966403:0:14264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.966451:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910e596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.968922:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778560 00000100:00100000:1.0:1784045396.968938:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778560 00000100:00100000:1.0:1784045396.969009:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784045396.969018:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14264:x1870706829778560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045396.969292:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14264:x1870706829778560:12345-0@lo:502:llog_process_th.0 Request processed in 275us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.969300:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045396.969522:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14264:1870706829778560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784045396.969564:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784045396.969694:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1784045396.969713:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045396.969727:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ddc2 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.969739:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa939e33400/0xdb5b5ff6a2d2ddbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2ddc2 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784045396.969782:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784045396.969785:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045396.969787:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045396.969788:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045396.969789:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045396.969791:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045396.969792:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045396.969793:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045396.969795:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045396.969796:0:14218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784045396.969800:0:14218:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784045396.969803:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784045396.969804:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045396.969805:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045396.969807:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045396.969807:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045396.969809:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045396.969810:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045396.969811:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045396.969812:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045396.969813:0:14218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784045396.969849:0:14218:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784045396.969865:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829778688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784045396.969905:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045396.969932:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9082893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.970059:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778688 00000100:00100000:1.0:1784045396.970064:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778688 00000100:00100000:1.0:1784045396.970101:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784045396.970108:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14218:x1870706829778688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784045396.970136:0:14229:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784045396.970150:0:14229:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784045397.040395:0:14229:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784045397.040420:0:14229:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784045397.040562:0:14252:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784045397.040567:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784045397.040589:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.040609:0:14252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.040620:0:14252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.040670:0:14252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.040685:0:14252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 12 pid: 14231 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.040701:0:14252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1870706829778816:0@lo:104: 00000100:00100000:1.0:1784045397.040769:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045397.040860:0:14252:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10f180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045397.040922:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778816 00000100:00100000:0.0:1784045397.040930:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778816 00000100:00100000:0.0:1784045397.040986:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045397.040995:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14252:x1870706829778816:12345-0@lo:104: 00010000:00010000:0.0:1784045397.041009:0:14219:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041064:0:14219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045397.041070:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14252:x1870706829778816:12345-0@lo:104: Request processed in 76us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045397.041077:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784045397.041097:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045397.041103:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041111:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045397.041115:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041124:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045397.041143:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045397.041148:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045397.041185:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041192:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045397.041212:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041219:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa939e32200/0xdb5b5ff6a2d2dd9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2dda6 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041235:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045397.041236:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045397.041238:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045397.041260:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829778944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045397.041287:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045397.041359:0:14252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1870706829778816:0@lo:104: 00010000:00010000:0.0:1784045397.041378:0:14252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.041462:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829778944 00000100:00100000:1.0:1784045397.041467:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829778944 00010000:00010000:1.0:1784045397.041484:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 13 pid: 14231 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.041511:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045397.041518:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+13:3318:x1870706829778944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045397.041528:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045397.041533:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 13 pid: 14231 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041544:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 13 pid: 14231 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041558:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa92d360400/0xdb5b5ff6a2d2dda6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2dd9f expref: 13 pid: 14231 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041571:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041579:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045397.041591:0:14221:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001025500s 00010000:00010000:1.0:1784045397.041596:0:14221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041603:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041610:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041623:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041627:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045397.041641:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041648:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041667:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.041677:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045397.041712:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:3318:x1870706829778944:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045397.041719:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045397.041756:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829778944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045397.041907:0:14252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041915:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.041932:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa92d361e00/0xdb5b5ff6a2d2ddd7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.067877:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14218:x1870706829778688:12345-0@lo:253:mount.lustre.0 Request processed in 97758us (97961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045397.067893:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784045397.068441:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14218:1870706829778688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784045397.068470:0:14218:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784045397.068474:0:14218:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784045397.068476:0:14218:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045397.068477:0:14218:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045397.068478:0:14218:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045397.068479:0:14218:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045397.068480:0:14218:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045397.068481:0:14218:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045397.068482:0:14218:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045397.068485:0:14218:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045397.068486:0:14218:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784045397.068500:0:14218:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784045397.076499:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045397.076673:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045397.076985:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045397.077131:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045397.077374:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045397.077527:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045397.080027:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045397.080192:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045397.080503:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045397.080737:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045397.081190:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045397.081347:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1784045397.114158:0:14218:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1784045397.114628:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1784045397.114885:0:14275:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1784045397.114889:0:14275:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1784045397.114973:0:14276:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1784045397.115046:0:14276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045397.117143:0:14276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784045397.117228:0:14276:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784045397.117233:0:14276:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1784045397.119993:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784045397.120116:0:14218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784045397.120621:0:14218:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784045397.121194:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784045397.121622:0:14218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045397.122802:0:14218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1784045397.123576:0:14218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784045397.123611:0:14218:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1784045397.135066:0:14218:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1784045397.139693:0:14218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1784045397.162383:0:14218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784045397.162436:0:14218:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb518c1973988 00100000:10000000:0.0:1784045397.162445:0:14218:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784045397.163272:0:14218:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784045397.163288:0:14218:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784045397.163304:0:14218:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784045397.163331:0:14218:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1784045397.538593:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045397.986998:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1784045398.497049:0:14233:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784045398.497057:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa939d58800 from 6 10000000:01000000:3.0:1784045398.497061:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784045398.497113:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.497144:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.497154:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045398.497178:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829779072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045398.497593:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045398.498211:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9061f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1784045398.508247:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779072 00000100:00100000:2.0:1784045398.508263:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779072 00000100:00100000:2.0:1784045398.508338:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045398.508349:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14233:x1870706829779072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045398.508367:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045398.508391:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ddde expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.508510:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.508521:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.508530:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720800, rc 0) 00000100:00100000:2.0:1784045398.508631:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829779072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (11036us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.508653:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045398.508763:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829779072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045398.508782:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.508793:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045398.508918:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829779200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784045398.508956:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045398.508991:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9061f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045398.509049:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779200 00000100:00100000:1.0:1784045398.509054:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779200 00000100:00100000:1.0:1784045398.509083:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784045398.509090:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829779200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784045398.509104:0:14229:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784045398.509120:0:14229:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784045398.509123:0:14229:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784045398.509202:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829779200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045398.509210:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045398.509303:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829779200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784045398.509346:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784045398.509353:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.509362:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.578049:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045399.009515:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784045399.588163:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045400.609074:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784045401.583608:0:14519:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784045401.633045:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784045402.017944:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045402.017951:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045402.017953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045402.017956:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045402.017959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784045402.017962:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784045402.017966:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa93b59c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045402.017978:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8aa93b59c800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1784045402.017999:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa939f4e300 x1870706829779456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045402.018021:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045402.018038:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829779328:0@lo:400:kworker.0 00000100:00100000:3.0:1784045402.018120:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045402.019555:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829779456:0@lo:38:kworker.0 00000100:00100000:2.0:1784045402.019660:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045402.019712:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779328 00000100:00100000:2.0:1784045402.019719:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779328 00000100:00100000:2.0:1784045402.019767:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045402.019776:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:3318:x1870706829779328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045402.019854:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:3318:x1870706829779328:12345-0@lo:400:kworker.0 Request processed in 80us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045402.019863:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045402.019915:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829779328:0@lo:400:kworker.0 00000100:00100000:0.0:1784045402.020106:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779456 00000100:00100000:0.0:1784045402.020111:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779456 00000100:00100000:0.0:1784045402.020139:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045402.020144:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1870706829779456:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784045402.020919:0:14238:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1784045402.020955:0:14238:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdb5b5ff6a2d2ddec 00000004:00100000:0.0:1784045402.020970:0:14238:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045402.021111:0:14238:0:(import.c:65:import_set_state_nolock()) ffff8aa90facf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045402.021641:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1870706829779456:12345-0@lo:38:kworker.0 Request processed in 1494us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045402.021651:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045402.021797:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa939f4e300 x1870706829779456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784045402.021815:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784045402.021823:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784045402.021861:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784045402.021864:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93b59c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784045402.021871:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1870706829779456:0@lo:38:kworker.0 00010000:00010000:2.0:1784045402.662878:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045403.685182:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045404.598054:0:14669:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd93ec4830 20000000:00000080:0.0:1784045404.598073:0:14669:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa939d46400 uarg=0000000000000000 20000000:01000000:0.0:1784045404.598108:0:14669:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1784045404.598115:0:14669:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1784045404.598119:0:14669:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1784045404.599397:0:14670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1784045404.599584:0:14669:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784045404.606747:0:14669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784045404.609643:0:14669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.609667:0:14669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.609675:0:14669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.609718:0:14669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 11 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.609731:0:14669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 11 pid: 14229 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045404.609744:0:14669:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14669:1870706829779584:0@lo:104: 00000100:00100000:0.0:1784045404.609820:0:14669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045404.610067:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779584 00000100:00100000:1.0:1784045404.610075:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779584 00000100:00100000:1.0:1784045404.610136:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045404.610145:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14669:x1870706829779584:12345-0@lo:104: 00010000:00010000:1.0:1784045404.610159:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.610220:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045404.610226:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14669:x1870706829779584:12345-0@lo:104: Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.610233:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045404.610393:0:14669:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045404.610416:0:14669:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14669:1870706829779584:0@lo:104: 00010000:00010000:0.0:1784045404.610436:0:14669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.610592:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045404.610599:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.610606:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721a00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045404.610611:0:14225:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.610619:0:14225:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045404.610633:0:14225:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045404.610638:0:14225:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045404.610711:0:14225:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.610717:0:14225:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045404.610744:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.610750:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa937721a00/0xdb5b5ff6a2d2ddad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2ddb4 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.610765:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045404.610766:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045404.610768:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045404.610785:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045404.610806:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829779712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045404.610869:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045404.611031:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779712 00000100:00100000:3.0:1784045404.611035:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779712 00010000:00010000:3.0:1784045404.611055:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 12 pid: 14229 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045404.611079:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045404.611086:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:3321:x1870706829779712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045404.611097:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045404.611108:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 12 pid: 14229 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611179:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 12 pid: 14229 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611195:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2ddb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddad expref: 12 pid: 14229 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611211:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611218:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611231:0:14222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611239:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611245:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611252:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611258:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045404.611262:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611270:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611288:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.611362:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045404.611396:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:3321:x1870706829779712:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045404.611403:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045404.611439:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829779712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045404.612275:0:14669:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.612285:0:14669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.612291:0:14669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa939e32000/0xdb5b5ff6a2d2ddf3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045404.707286:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045405.731860:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784045406.113334:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045406.113342:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa939d58800 from 10 10000000:01000000:1.0:1784045406.113349:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045406.113397:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045406.113410:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045406.113420:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045406.113446:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829779840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045406.113538:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045406.113590:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045406.113654:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829779840 00000100:00100000:2.0:1784045406.113662:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829779840 00000100:00100000:2.0:1784045406.113721:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045406.113732:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+11:14233:x1870706829779840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045406.113745:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045406.113760:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2ddfa expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045406.113784:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045406.113795:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045406.113823:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721a00, rc 0) 00000100:00100000:2.0:1784045406.113901:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829779840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045406.113909:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045406.114165:0:3317:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045396/real 1784045396] req@ffff8aa939f4ce00 x1870706829776768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045406.114187:0:3317:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa939f4ce00 x1870706829776768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045406.114199:0:3317:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045396/real 1784045396] req@ffff8aa92d02d500 x1870706829776640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045406.114213:0:3317:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa92d02d500 x1870706829776640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784045406.114235:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045406.114252:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784045406.114256:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829776768:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784045406.114263:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa904d8d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045406.114269:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784045406.114273:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829776640:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784045406.114303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045406.114308:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784045406.114311:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa904d8d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045406.114316:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1784045406.114321:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784045406.114326:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa904d8d000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045406.114334:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829779840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045406.114350:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa92d02d500 x1870706829779968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784045406.114353:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.114374:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784045406.114377:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045406.114385:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784045406.114388:0:8:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045406.114391:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1784045406.114394:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784045406.114398:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa93f7c5000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1784045406.114410:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa92d02dc00 x1870706829780096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045406.114453:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829780224:0@lo:400:kworker.0 00000100:00100000:1.0:1784045406.114509:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045406.114564:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780224 00000100:00100000:1.0:1784045406.114568:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780224 00000100:00100000:1.0:1784045406.114602:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045406.114610:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829780224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045406.114647:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829780352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045406.114654:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829780224:12345-0@lo:400:kworker.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045406.114662:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784045406.114697:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa92d02d180 x1870706829780224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045406.114707:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045406.114716:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829780224:0@lo:400:kworker.0 00000100:00100000:0.0:1784045406.114737:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa918a8b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045406.114739:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829779968:0@lo:8:kworker.0 00000400:00000100:1.0:1784045406.114765:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706829779968 offset 0 length 520: 4 00000100:00100000:1.0:1784045406.114778:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829780096:0@lo:8:kworker.0 00000400:00000100:1.0:1784045406.114790:0:3317:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706829780096 offset 0 length 520: 4 00000100:00100000:2.0:1784045406.114913:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780352 00000100:00100000:2.0:1784045406.114917:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780352 00000100:00100000:2.0:1784045406.115144:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045406.115153:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829780352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045406.115360:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829780352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045406.115367:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045406.115399:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829780352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045406.115432:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829780480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045406.115468:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045406.115500:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa937f149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045406.115511:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780480 00000100:00100000:2.0:1784045406.115514:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780480 00000100:00100000:2.0:1784045406.115529:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045406.115534:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829780480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045406.115670:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14233:x1870706829780480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045406.115677:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045406.115707:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829780480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784045406.117444:0:14730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784045406.117771:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784045406.117793:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045406.117803:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045406.117815:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.754020:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045407.778967:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045408.803809:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045409.316826:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784045409.827688:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784045409.849465:0:14871:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784045409.849469:0:14871:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1784045409.849580:0:14871:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8aa90fac8800 00000020:01000004:0.0:1784045409.849595:0:14871:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784045409.849610:0:14871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784045409.849624:0:14871:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8aa9060c19c0) 00000020:00000080:0.0:1784045409.849644:0:14871:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784045409.876597:0:14871:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1784045409.876914:0:14871:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1784045409.880479:0:14871:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1784045409.880721:0:14871:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1784045409.880989:0:14871:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1784045409.881587:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1784045409.881728:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1784045409.881817:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1784045409.895149:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 774: rc = 0 00100000:10000000:1.0:1784045409.896727:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 774: rc = 0 00100000:10000000:1.0:1784045409.897042:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:2.0:1784045409.897875:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 774: rc = 0 00100000:10000000:2.0:1784045409.898154:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:2.0:1784045409.899901:0:14871:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00000020:00000080:2.0:1784045409.900558:0:14871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784045409.900570:0:14871:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045409.900581:0:14871:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb5b5ff6a2d2de0f 00000020:01000004:2.0:1784045409.900590:0:14871:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784045409.900610:0:14871:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784045409.900614:0:14871:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784045409.900619:0:14871:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784045409.900625:0:14871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784045409.900637:0:14871:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8aa93b593380) 00000020:00000080:2.0:1784045409.900648:0:14871:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1784045409.907959:0:14871:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045409.908139:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784045409.908144:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1784045409.912024:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1784045409.912036:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784045409.912481:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784045409.912487:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784045409.913886:0:14871:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045409.914486:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784045409.914492:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784045409.917967:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784045409.917988:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784045409.941613:0:14871:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045409.942200:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784045409.942271:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784045409.954981:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784045409.955103:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784045409.955939:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784045409.955948:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784045409.958288:0:14871:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045409.958523:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784045409.958529:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784045409.963001:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784045409.963017:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784045410.036385:0:14871:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045410.039489:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784045410.039501:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784045410.042551:0:14871:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784045410.042566:0:14871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784045410.043143:0:14871:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784045410.043167:0:14871:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784045410.043174:0:14871:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784045410.059111:0:14871:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784045410.059149:0:14871:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1784045410.059153:0:14871:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784045410.059155:0:14871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784045410.059157:0:14871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045410.059158:0:14871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045410.059159:0:14871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045410.059160:0:14871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045410.059162:0:14871:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045410.059164:0:14871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045410.059165:0:14871:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784045410.059169:0:14871:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1784045410.059171:0:14871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784045410.059172:0:14871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784045410.059173:0:14871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045410.059174:0:14871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045410.059175:0:14871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045410.059176:0:14871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045410.059177:0:14871:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045410.059178:0:14871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045410.059179:0:14871:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784045410.059205:0:14871:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784045410.059226:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784045410.059309:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.059359:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9082896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.059705:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780608 00000100:00100000:3.0:1784045410.059713:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780608 00000100:00100000:3.0:1784045410.059772:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045410.059781:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14871:x1870706829780608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784045410.059812:0:14229:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784045410.059815:0:14229:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1784045410.059819:0:14229:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784045410.070129:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14871:x1870706829780608:12345-0@lo:253:mount.lustre.0 Request processed in 10339us (10811us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.070159:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784045410.070284:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784045410.070299:0:14871:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784045410.070303:0:14871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784045410.070304:0:14871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784045410.070305:0:14871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045410.070313:0:14871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045410.070314:0:14871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045410.070316:0:14871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045410.070317:0:14871:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045410.070319:0:14871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045410.070321:0:14871:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784045410.070344:0:14871:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa90fac8800 from lustre-OST0000 10000000:01000000:1.0:1784045410.070373:0:14871:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784045410.070376:0:14871:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784045410.070383:0:14871:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa907feb380 local copy 00010000:00010000:1.0:1784045410.070394:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045410.070639:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045410.070683:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.070723:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908289b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045410.070859:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780736 00000100:00100000:2.0:1784045410.070866:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780736 00000100:00100000:2.0:1784045410.070912:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784045410.070921:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14871:x1870706829780736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045410.071103:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14871:x1870706829780736:12345-0@lo:501:mount.lustre.0 Request processed in 183us (419us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045410.071109:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045410.071825:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780736:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784045410.071879:0:14871:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784045410.072050:0:14871:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784045410.072058:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.072068:0:14871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045410.072090:0:14871:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa90fac8800 10000000:01000000:1.0:1784045410.072094:0:14871:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784045410.072099:0:14871:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8aa907feb380 10000000:01000000:1.0:1784045410.072101:0:14871:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784045410.072104:0:14871:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8aa907feb380 from 1 10000000:01000000:1.0:1784045410.072107:0:14871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784045410.072139:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.072147:0:14871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.072157:0:14871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045410.072173:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045410.072223:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.072254:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908289b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.072349:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780864 00000100:00100000:3.0:1784045410.072355:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780864 00000100:00100000:3.0:1784045410.072381:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784045410.072388:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+12:14871:x1870706829780864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045410.072400:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045410.072421:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2de24 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2de1d expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.072443:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2de24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de1d expref: 13 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.072454:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942045e00/0xdb5b5ff6a2d2de24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de1d expref: 13 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.072462:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942045e00, rc 0) 00000100:00100000:3.0:1784045410.072505:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+13:14871:x1870706829780864:12345-0@lo:101:mount.lustre.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.072511:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045410.073728:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045410.073753:0:14871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de24 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.073765:0:14871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2de24 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045410.073787:0:14871:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784045410.073870:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de24 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.073880:0:14871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d360800/0xdb5b5ff6a2d2de1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de24 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045410.073888:0:14871:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784045410.073896:0:14871:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045410.073903:0:14871:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784045410.073917:0:14871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784045410.073946:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.073954:0:14871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.073963:0:14871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045410.073983:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045410.074035:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.074068:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa908289b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.074220:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829780992 00000100:00100000:3.0:1784045410.074227:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829780992 00000100:00100000:3.0:1784045410.074279:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045410.074287:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+13:14871:x1870706829780992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045410.074299:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045410.074311:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942044e00/0xdb5b5ff6a2d2de32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2de2b expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.074329:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942044e00/0xdb5b5ff6a2d2de32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de2b expref: 14 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.074343:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942044e00/0xdb5b5ff6a2d2de32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de2b expref: 14 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.074351:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942044e00, rc 0) 00000100:00100000:3.0:1784045410.074385:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829780992:12345-0@lo:101:mount.lustre.0 Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.074390:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045410.074557:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829780992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045410.074567:0:14871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de32 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.074575:0:14871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2de32 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045410.075329:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1784045410.079689:0:14871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045410.080035:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1784045410.080098:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1784045410.080136:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1784045410.080185:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1784045410.080239:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1784045410.080275:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1784045410.080339:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1784045410.080347:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1784045410.080481:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045410.080562:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.080605:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9082893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045410.080824:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781120 00000100:00100000:0.0:1784045410.080859:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781120 00000100:00100000:0.0:1784045410.080914:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045410.080923:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045410.081277:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781120:12345-0@lo:501:mount.lustre.0 Request processed in 352us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045410.081286:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784045410.081731:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045410.081773:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045410.081818:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.081864:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa901254840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.081918:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781248 00000100:00100000:3.0:1784045410.081924:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781248 00000100:00100000:3.0:1784045410.081960:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784045410.081968:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045410.082330:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781248:12345-0@lo:503:mount.lustre.0 Request processed in 362us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.082337:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784045410.082502:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784045410.083152:0:14871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045410.083248:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045410.083291:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.083326:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.083523:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781376 00000100:00100000:3.0:1784045410.083528:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781376 00000100:00100000:3.0:1784045410.083566:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045410.083626:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045410.083811:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781376:12345-0@lo:502:mount.lustre.0 Request processed in 238us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.083819:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784045410.084151:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045410.084467:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1784045410.084519:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1784045410.084552:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1784045410.084679:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1784045410.084722:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1784045410.084756:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1784045410.084807:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1784045410.084879:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1784045410.084918:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1784045410.084968:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1784045410.085006:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1784045410.085054:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1784045410.085087:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045410.085144:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.085176:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.085717:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781504 00000100:00100000:3.0:1784045410.085723:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781504 00000100:00100000:3.0:1784045410.085760:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045410.085767:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045410.085980:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781504:12345-0@lo:502:mount.lustre.0 Request processed in 213us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.085994:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045410.086149:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045410.086242:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1784045410.086253:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1784045410.087298:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784045410.087308:0:14885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1784045410.087315:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045410.087318:0:14885:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784045410.087323:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784045410.087338:0:14885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8aa907e94d40) 00000020:00000080:1.0:1784045410.087361:0:14885:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784045410.087368:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784045410.087446:0:14885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa90fac8800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784045410.087457:0:14885:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784045410.087464:0:14885:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdb5b5ff6a2d2de40 00010000:00010000:2.0:1784045410.095917:0:14885:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1784045410.098093:0:14885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1784045410.100765:0:14885:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1784045410.104528:0:14885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784045410.104541:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045410.104547:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045410.104549:0:14885:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784045410.104552:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784045410.104555:0:14885:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1784045410.104556:0:14885:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045410.104558:0:14885:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045410.104559:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784045410.104562:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045410.104563:0:14885:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784045410.104565:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045410.104568:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045410.104569:0:14885:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045410.104572:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045410.104574:0:14885:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784045410.104588:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045410.104590:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045410.104592:0:14885:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784045410.104595:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045410.104597:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045410.104598:0:14885:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784045410.104602:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784045410.104665:0:14885:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045410.104668:0:14885:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045410.104669:0:14885:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784045410.104672:0:14885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1784045410.104974:0:14871:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1784045410.105003:0:14871:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784045410.105028:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de32 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.105040:0:14871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d360a00/0xdb5b5ff6a2d2de2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de32 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045410.105048:0:14871:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90fac8800 from 1 10000000:01000000:1.0:1784045410.105051:0:14871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045410.105092:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.105112:0:14871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045410.105124:0:14871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045410.105149:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045410.105248:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.105287:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa914fe1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045410.109480:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781632 00000100:00100000:2.0:1784045410.109505:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781632 00000100:00100000:2.0:1784045410.109921:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784045410.109932:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+14:14871:x1870706829781632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045410.109950:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045410.109975:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2de47 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045410.110004:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 15 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045410.110017:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 15 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045410.110026:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045410.110105:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+15:14871:x1870706829781632:12345-0@lo:101:mount.lustre.0 Request processed in 176us (4857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045410.110112:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045410.110200:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045410.110231:0:14871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.110241:0:14871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045410.110957:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784045410.112517:0:14871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045410.115166:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784045410.115363:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784045410.115448:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784045410.115458:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784045410.115557:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045410.115706:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.115758:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9055df900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045410.115872:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781760 00000100:00100000:1.0:1784045410.115878:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781760 00000100:00100000:1.0:1784045410.115931:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045410.115941:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+15:14871:x1870706829781760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045410.116330:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045410.116366:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045410.120361:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.120426:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.120478:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829781888 00000100:00100000:3.0:1784045410.120487:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829781888 00000100:00100000:3.0:1784045410.120541:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045410.120551:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829781888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045410.120798:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829781888:12345-0@lo:503:mount.lustre.0 Request processed in 248us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.120806:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784045410.121036:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829781888:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784045410.121675:0:14871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045410.121748:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045410.121802:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.121875:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.122028:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782016 00000100:00100000:3.0:1784045410.122034:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782016 00000100:00100000:3.0:1784045410.122069:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045410.122083:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045410.122386:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782016:12345-0@lo:502:mount.lustre.0 Request processed in 303us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.122393:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784045410.122659:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045410.127018:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784045410.127119:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784045410.127174:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784045410.127309:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784045410.127357:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1784045410.127439:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784045410.127491:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784045410.127528:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1784045410.127652:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045410.127739:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.127852:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.139390:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782144 00000100:00100000:3.0:1784045410.139406:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782144 00000100:00100000:3.0:1784045410.139475:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045410.139485:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045410.139780:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782144:12345-0@lo:502:mount.lustre.0 Request processed in 295us (12040us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.139788:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045410.143378:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045410.143604:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784045410.143618:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784045410.145438:0:14889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045410.145448:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045410.145451:0:14889:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784045410.145457:0:14889:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa90fac8800 00000020:00000080:3.0:1784045410.145459:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784045410.145466:0:14889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045410.145469:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045410.145471:0:14889:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784045410.145473:0:14889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045410.145476:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045410.145477:0:14889:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045410.145480:0:14889:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa90fac8800 00000020:00000080:3.0:1784045410.145483:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784045410.145539:0:14889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045410.145543:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045410.145552:0:14889:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784045410.145555:0:14889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045410.145558:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045410.145560:0:14889:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784045410.145563:0:14889:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa90fac8800 00000020:00000080:3.0:1784045410.145565:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784045410.148787:0:14889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045410.148800:0:14889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045410.148802:0:14889:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784045410.148808:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1784045410.148894:0:14871:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1784045410.148921:0:14871:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045410.148939:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.148952:0:14871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045410.148996:0:14871:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784045410.148999:0:14871:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa90fac8800 10000000:01000000:3.0:1784045410.149002:0:14871:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa90fac8800 10000000:01000000:3.0:1784045410.149006:0:14871:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045410.149012:0:14871:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa90fac8800 from 1 10000000:01000000:3.0:1784045410.149014:0:14871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045410.149053:0:14871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.149061:0:14871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.149071:0:14871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045410.149113:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045410.149187:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.150985:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125b5780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.151027:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782272 00000100:00100000:3.0:1784045410.151035:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782272 00000100:00100000:3.0:1784045410.151089:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045410.151098:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045410.151115:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045410.151132:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173a00/0xdb5b5ff6a2d2de5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2de55 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.151158:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173a00/0xdb5b5ff6a2d2de5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de55 expref: 17 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.151170:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173a00/0xdb5b5ff6a2d2de5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de55 expref: 17 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.151179:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173a00, rc 0) 00000100:00100000:3.0:1784045410.151251:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14871:x1870706829782272:12345-0@lo:101:mount.lustre.0 Request processed in 154us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.151259:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045410.151322:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045410.151342:0:14871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de5c expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.151352:0:14871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2de5c expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045410.151988:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1784045410.164719:0:14871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045410.165066:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784045410.165112:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784045410.165144:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784045410.165188:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784045410.165240:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784045410.165288:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784045410.165321:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784045410.165353:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784045410.165399:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784045410.165448:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784045410.165481:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784045410.165526:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784045410.165576:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784045410.165608:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784045410.165654:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784045410.165691:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784045410.165723:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784045410.165767:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784045410.165801:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784045410.165862:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784045410.165913:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784045410.165948:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784045410.165978:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784045410.166022:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784045410.166056:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1784045410.166086:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1784045410.166129:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1784045410.166163:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1784045410.166248:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1784045410.166261:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1784045410.166369:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045410.166456:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.166513:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782400 00000100:00100000:3.0:1784045410.166521:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782400 00000100:00100000:3.0:1784045410.166561:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045410.166569:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14871:x1870706829782400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045410.166766:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14871:x1870706829782400:12345-0@lo:501:mount.lustre.0 Request processed in 197us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.166774:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045410.166817:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125b5780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.166859:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045410.166893:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045410.166930:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.166950:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782528 00000100:00100000:3.0:1784045410.166954:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782528 00000100:00100000:3.0:1784045410.166972:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045410.166978:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14871:x1870706829782528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045410.167114:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14871:x1870706829782528:12345-0@lo:503:mount.lustre.0 Request processed in 135us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.167120:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045410.167150:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0b780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.167161:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045410.170282:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829781760:12345-0@lo:501:mount.lustre.0 Request processed in 54333us (54567us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045410.170297:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000040:00080000:3.0:1784045410.182026:0:14871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045410.182137:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045410.182699:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.187686:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045410.200763:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782656 00000100:00100000:2.0:1784045410.200778:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782656 00000100:00100000:2.0:1784045410.200854:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045410.200865:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045410.202320:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782656:12345-0@lo:502:mount.lustre.0 Request processed in 1451us (19616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045410.202331:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784045410.209651:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045410.210729:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784045410.210795:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784045410.210856:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784045410.210919:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784045410.210956:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784045410.211002:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784045410.211038:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784045410.211068:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784045410.211112:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784045410.211146:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784045410.211177:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784045410.211221:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784045410.211269:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784045410.211304:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784045410.211349:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784045410.211908:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784045410.211954:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784045410.212002:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784045410.212039:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784045410.212076:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784045410.212123:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784045410.212161:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784045410.212194:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784045410.212243:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784045410.212281:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1784045410.212315:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1784045410.215684:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1784045410.215813:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1784045410.216756:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1784045410.218155:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1784045410.218245:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1784045410.218281:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1784045410.218312:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1784045410.218370:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1784045410.218432:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1784045410.218501:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1784045410.218535:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1784045410.218562:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1784045410.221145:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1784045410.221202:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1784045410.221255:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045410.221342:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.222524:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045410.229520:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782784 00000100:00100000:0.0:1784045410.229536:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782784 00000100:00100000:0.0:1784045410.229614:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045410.229626:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045410.229961:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829782784:12345-0@lo:502:mount.lustre.0 Request processed in 336us (8617us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045410.229969:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045410.230169:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829782784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045410.230298:0:14871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784045410.230313:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1784045410.232757:0:14894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784045410.232774:0:14894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8aa9060c0000) 00000020:00000080:0.0:1784045410.232797:0:14894:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1784045410.233343:0:14894:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa90fac8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784045410.233348:0:14894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa90fac8800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784045410.233351:0:14894:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa90fac8800 3 00010000:00080000:0.0:1784045410.233396:0:14894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa939db2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1784045410.235027:0:14894:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1784045410.235148:0:14894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784045410.235183:0:14894:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784045410.235195:0:14894:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdb5b5ff6a2d2de6a 00000100:00080000:0.0:1784045410.235206:0:14894:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045410.235211:0:14894:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8aa939db2800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045410.235248:0:14894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937d34000 x1870706829782912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045410.235280:0:14894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784045410.235310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045410.235314:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045410.235317:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045410.235320:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784045410.235368:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829783040:0@lo:400:kworker.0 00000100:00100000:1.0:1784045410.242061:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829782912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784045410.243021:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045410.243223:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829782912 00000100:00100000:2.0:1784045410.243231:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829782912 00000100:00100000:2.0:1784045410.243269:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045410.243277:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1870706829782912:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784045410.243305:0:14236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:2.0:1784045410.243342:0:14236:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdb5b5ff6a2d2de71 00000004:00100000:2.0:1784045410.243358:0:14236:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784045410.243416:0:14236:0:(import.c:65:import_set_state_nolock()) ffff8aa910d95000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045410.243474:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1870706829782912:12345-0@lo:38:llog_process_th.0 Request processed in 197us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045410.243482:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784045410.244621:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa937d34000 x1870706829782912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045410.244636:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045410.244647:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784045410.244655:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784045410.244661:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784045410.244664:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa939db2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784045410.244680:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1870706829782912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784045410.245131:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045410.246994:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783040 00000100:00100000:1.0:1784045410.247007:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783040 00000100:00100000:1.0:1784045410.247061:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045410.247070:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829783040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045410.247154:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1870706829783040:12345-0@lo:400:kworker.0 Request processed in 85us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045410.247161:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784045410.249333:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8aa937d37480 x1870706829783040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045410.249351:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1870706829783040:0@lo:400:kworker.0 00000040:00080000:1.0:1784045410.251184:0:14894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1784045410.252143:0:14871:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1784045410.252193:0:14871:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784045410.252216:0:14871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de5c expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.252229:0:14871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942044a00/0xdb5b5ff6a2d2de55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de5c expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784045410.252278:0:14871:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784045410.252280:0:14871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045410.252281:0:14871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045410.252283:0:14871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045410.252284:0:14871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045410.252289:0:14871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045410.252291:0:14871:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045410.252292:0:14871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045410.252293:0:14871:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045410.252297:0:14871:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1784045410.252299:0:14871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045410.252300:0:14871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045410.252301:0:14871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045410.252302:0:14871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045410.252303:0:14871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045410.252304:0:14871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045410.252304:0:14871:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045410.252305:0:14871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045410.252306:0:14871:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045410.252331:0:14871:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784045410.252353:0:14871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829783168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784045410.252541:0:14871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.252590:0:14871:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045410.252647:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783168 00000100:00100000:2.0:1784045410.252656:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783168 00000100:00100000:2.0:1784045410.252716:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045410.252737:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14871:x1870706829783168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784045410.252764:0:14231:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784045410.252778:0:14231:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784045410.298484:0:14231:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784045410.298500:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784045410.298543:0:14252:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784045410.298547:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784045410.298569:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.298589:0:14252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 16 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.298598:0:14252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.298641:0:14252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 16 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.298654:0:14252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 16 pid: 14230 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045410.298682:0:14252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1870706829783296:0@lo:104: 00000100:00100000:3.0:1784045410.298746:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.298787:0:14252:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045410.298818:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783296 00000100:00100000:3.0:1784045410.298826:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783296 00000100:00100000:3.0:1784045410.298893:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045410.298902:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14252:x1870706829783296:12345-0@lo:104: 00010000:00010000:3.0:1784045410.298914:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.298965:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045410.298972:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14252:x1870706829783296:12345-0@lo:104: Request processed in 71us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.298978:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1784045410.299004:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045410.299009:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299017:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942044c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045410.299021:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299031:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045410.299038:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045410.299054:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045410.299086:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299092:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045410.299111:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299118:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa942044c00/0xdb5b5ff6a2d2ddde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2dde5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299135:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045410.299136:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045410.299138:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045410.299156:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829783424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045410.299184:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045410.299224:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783424 00000100:00100000:3.0:1784045410.299228:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783424 00010000:00010000:3.0:1784045410.299243:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 17 pid: 14230 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045410.299263:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045410.299270:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:3319:x1870706829783424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045410.299293:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045410.299299:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 17 pid: 14230 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299308:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 17 pid: 14230 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299326:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299333:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784045410.299344:0:14223:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001025500s 00010000:00010000:3.0:1784045410.299348:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299355:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299361:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299367:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299373:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045410.299377:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299398:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299415:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299426:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045410.299454:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:3319:x1870706829783424:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045410.299466:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045410.299501:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829783424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045410.299527:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720800/0xdb5b5ff6a2d2dde5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddde expref: 16 pid: 14230 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045410.299537:0:14252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1870706829783296:0@lo:104: 00010000:00010000:3.0:1784045410.299547:0:14252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299556:0:14252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299561:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.299567:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045410.338131:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+15:14871:x1870706829783168:12345-0@lo:253:mount.lustre.0 Request processed in 85384us (85578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045410.338150:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045410.338265:0:14871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14871:1870706829783168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784045410.338282:0:14871:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784045410.338286:0:14871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045410.338288:0:14871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045410.338289:0:14871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045410.338290:0:14871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045410.338291:0:14871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045410.338292:0:14871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045410.338294:0:14871:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045410.338296:0:14871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045410.338297:0:14871:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784045410.338338:0:14871:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784045410.347102:0:14871:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784045410.347356:0:14871:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784045410.347666:0:14871:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784045410.347823:0:14871:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784045410.348001:0:14871:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784045410.353476:0:14871:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784045410.359811:0:14871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784045410.524507:0:14871:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784045410.524530:0:14871:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784045410.524564:0:14871:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784045410.524641:0:14871:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784045410.524658:0:14871:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784045410.524692:0:14871:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784045410.855902:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784045411.750327:0:14233:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784045411.750336:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa939d58800 from 7 10000000:01000000:1.0:1784045411.750340:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045411.750463:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045411.750476:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045411.750488:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045411.750516:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829783552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045411.750651:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045411.750862:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa910138600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045411.753774:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783552 00000100:00100000:3.0:1784045411.753789:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783552 00000100:00100000:3.0:1784045411.754340:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045411.754352:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+15:14233:x1870706829783552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045411.754378:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045411.754406:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2de7f expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045411.754435:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 16 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045411.754446:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 16 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045411.754454:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173c00, rc 0) 00000100:00100000:3.0:1784045411.754556:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14233:x1870706829783552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (3896us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045411.754562:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784045411.754652:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829783552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045411.754671:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045411.754691:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045411.754765:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829783680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784045411.754810:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045411.768567:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9060bc300 going to sleep for 11 seconds 00000100:00100000:1.0:1784045411.770122:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783680 00000100:00100000:1.0:1784045411.770136:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783680 00000100:00100000:1.0:1784045411.770198:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045411.770208:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14233:x1870706829783680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784045411.770244:0:14230:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784045411.770259:0:14230:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784045411.770262:0:14230:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1784045411.770431:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14233:x1870706829783680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 225us (15620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045411.770438:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045411.770481:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829783680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784045411.770564:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784045411.770575:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045411.770586:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045411.873176:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045412.897718:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045413.927815:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045414.946649:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045415.331436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045415.331444:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045415.331447:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045415.331450:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784045415.331534:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829784064:0@lo:400:kworker.0 00000100:00100000:0.0:1784045415.331558:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829783936:0@lo:400:kworker.0 00000100:00100000:1.0:1784045415.331659:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3320:1870706829783808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045415.332746:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045415.333752:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784064 00000100:00100000:2.0:1784045415.333763:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784064 00000100:00100000:2.0:1784045415.333823:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045415.333850:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045415.338624:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045415.339814:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045415.339876:0:14236:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045415.339887:0:14236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1784045415.339932:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045415.339948:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783808 00000100:00100000:1.0:1784045415.339956:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783808 00000100:00100000:1.0:1784045415.340014:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784045415.340025:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3320:x1870706829783808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045415.340085:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3320:x1870706829783808:12345-0@lo:400:kworker.0 Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045415.340094:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784045415.342096:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829783936 00000100:00100000:1.0:1784045415.342113:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829783936 00000100:00100000:1.0:1784045415.342161:0:14236:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045415.342173:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045415.342182:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829783936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045415.344158:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3320:1870706829783808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045415.347347:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829784064:12345-0@lo:400:kworker.0 Request processed in 13509us (14597us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045415.347366:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784045415.347427:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93f739500 x1870706829784064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045415.347457:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829784064:0@lo:400:kworker.0 00000100:00100000:1.0:1784045415.348105:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829783936:12345-0@lo:400:kworker.0 Request processed in 5921us (9486us total) trans 0 rc 0/0 00010000:00080000:0.0:1784045415.348181:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93f73a300 x1870706829783936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045415.348193:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829783936:0@lo:400:kworker.0 00000100:00100000:1.0:1784045415.348199:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784045415.980882:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045417.003676:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045418.022140:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045418.411701:0:15237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784045419.045151:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045419.554324:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784045420.071249:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784045420.472378:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045420.472386:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045420.472389:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045420.472391:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784045420.472423:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829784192:0@lo:400:kworker.0 00000100:00100000:0.0:1784045420.472505:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045420.472578:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784192 00000100:00100000:0.0:1784045420.472586:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784192 00000100:00100000:0.0:1784045420.472634:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045420.472643:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3319:x1870706829784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045420.472698:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3319:x1870706829784192:12345-0@lo:400:kworker.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045420.472706:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045420.472756:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829784192:0@lo:400:kworker.0 00000100:00100000:0.0:1784045420.472796:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829784320:0@lo:400:kworker.0 00000100:00100000:0.0:1784045420.472887:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045420.472954:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784320 00000100:00100000:3.0:1784045420.472959:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784320 00000100:00100000:3.0:1784045420.472988:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045420.472996:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829784320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045420.473039:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829784320:12345-0@lo:400:kworker.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045420.473046:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784045420.475327:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937d36d80 x1870706829784320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045420.475346:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829784320:0@lo:400:kworker.0 00000100:00100000:0.0:1784045420.475370:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045420.475379:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829784448:0@lo:400:kworker.0 00000100:00100000:0.0:1784045420.475433:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045420.476142:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784448 00000100:00100000:3.0:1784045420.476158:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784448 00000100:00100000:3.0:1784045420.476232:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045420.476250:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829784448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045420.476315:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829784448:12345-0@lo:400:kworker.0 Request processed in 66us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045420.476323:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1784045420.480028:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784045420.480093:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa92d02e680 x1870706829784448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045420.480110:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829784448:0@lo:400:kworker.0 00010000:00010000:2.0:1784045421.089046:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045421.540309:0:3317:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045406/real 1784045406] req@ffff8aa92d02d500 x1870706829779968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045421 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045421.540344:0:3317:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa92d02d500 x1870706829779968/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045421 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045421.540354:0:3317:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045406/real 1784045406] req@ffff8aa92d02dc00 x1870706829780096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045421 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045421.540366:0:3317:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8aa92d02dc00 x1870706829780096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045421 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784045421.540386:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa904d8d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045421.540409:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784045421.540413:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829779968:0@lo:8:kworker.0 00000100:00080000:1.0:1784045421.540419:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045421.540424:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1784045421.540426:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829780096:0@lo:8:kworker.0 00000100:00080000:0.0:1784045421.540535:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045421.540540:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1784045421.540555:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa904d8d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045421.540561:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1784045421.540566:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784045421.540579:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8aa904d8d000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045421.540602:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937d37100 x1870706829784704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045421.540615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045421.540618:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784045421.540620:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045421.540623:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1784045421.540625:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784045421.540628:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa93f7c5000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045421.540638:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937d34e00 x1870706829784832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045421.540687:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829785088:0@lo:400:kworker.0 00000100:00100000:0.0:1784045421.540760:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.541290:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829784960:0@lo:400:kworker.0 00000100:00100000:3.0:1784045421.541330:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.541354:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045421.541360:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829784576:0@lo:400:kworker.0 00000100:00100000:3.0:1784045421.541390:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.541424:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785088 00000100:00100000:3.0:1784045421.541431:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785088 00000100:00100000:3.0:1784045421.541518:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784960 00000100:00100000:3.0:1784045421.541521:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784960 00000100:00100000:3.0:1784045421.541545:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045421.541553:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829785088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045421.541629:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829785088:12345-0@lo:400:kworker.0 Request processed in 76us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045421.541637:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045421.541657:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045421.541663:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829784960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045421.541695:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829784960:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045421.541702:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784045421.541740:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937d37480 x1870706829784960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045421.541782:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829784960:0@lo:400:kworker.0 00010000:00080000:3.0:1784045421.541818:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937d34000 x1870706829785088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045421.541851:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829785088:0@lo:400:kworker.0 00000100:00100000:1.0:1784045421.542051:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784576 00000100:00100000:1.0:1784045421.542056:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784576 00000100:00100000:1.0:1784045421.542095:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784045421.542104:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3319:x1870706829784576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045421.542152:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3319:x1870706829784576:12345-0@lo:400:kworker.0 Request processed in 49us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.542159:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784045421.542193:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829784704:0@lo:8:kworker.0 00000100:00100000:1.0:1784045421.542242:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045421.542277:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829784832:0@lo:8:kworker.0 00000100:00100000:1.0:1784045421.542299:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045421.542339:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829784576:0@lo:400:kworker.0 00000100:00100000:3.0:1784045421.542924:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784704 00000100:00100000:3.0:1784045421.542930:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784704 00000100:00100000:3.0:1784045421.542950:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829784832 00000100:00100000:3.0:1784045421.542953:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829784832 00000100:00100000:3.0:1784045421.542962:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045421.542967:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3317:x1870706829784704:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784045421.542992:0:14873:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:3.0:1784045421.543021:0:14873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2de8d 00002000:00100000:3.0:1784045421.543036:0:14873:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8aa90396d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784045421.543041:0:14873:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784045421.543044:0:14873:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784045421.543430:0:14873:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784045421.543456:0:14873:0:(import.c:65:import_set_state_nolock()) ffff8aa90396c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045421.543525:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1870706829784704:12345-0@lo:8:kworker.0 Request processed in 556us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045421.543532:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045421.543550:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045421.543555:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3317:x1870706829784832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784045421.543566:0:14873:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784045421.543593:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3317:x1870706829784832:12345-0@lo:8:kworker.0 Request processed in 37us (1293us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045421.543608:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045421.543938:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937d37100 x1870706829784704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045421.543949:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045421.543957:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784045421.543966:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784045421.543971:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784045421.543973:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa904d8d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784045421.543992:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784045421.543997:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829784704:0@lo:8:kworker.0 00000100:00080000:1.0:1784045421.544010:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045421.544014:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784045421.544017:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829784832:0@lo:8:kworker.0 00000004:00080000:3.0:1784045421.544143:0:14259:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1784045421.544166:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1870706829785344:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784045421.544277:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829785216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045421.544334:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.544388:0:14259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.544414:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa914f22240 going to sleep for 11 seconds 00000004:00080000:3.0:1784045421.544431:0:14258:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784045421.544708:0:14258:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 456230876856ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784045421.544757:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785216 00000100:00100000:1.0:1784045421.544879:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785344 00000100:00100000:1.0:1784045421.544884:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785344 00000100:00100000:1.0:1784045421.544930:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045421.544937:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14259:x1870706829785344:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784045421.546294:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785216 00000100:00100000:3.0:1784045421.546345:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045421.546353:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1870706829785216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045421.546391:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045421.546462:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1870706829785216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045421.546469:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:1.0:1784045421.554516:0:14873:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1784045421.554528:0:14873:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1784045421.554534:0:14873:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00080000:0.0:1784045421.566879:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045421.566951:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa939f4fb80 x1870706829785216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045421.566980:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829785216:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1784045421.594957:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.594972:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.594991:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.594997:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.595004:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595023:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595033:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595041:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595070:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045421.595167:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045421.595185:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.595201:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045421.595223:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.595233:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.595253:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.595261:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2de94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.595280:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.595282:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.595284:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.595572:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.595578:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595599:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.595603:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.595608:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595618:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595626:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595632:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.595657:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784045421.596093:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.596099:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596107:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.596111:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.596115:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596124:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596142:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596150:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596166:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784045421.596176:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045421.596179:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596187:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.596190:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596198:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596209:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596232:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2de9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596247:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.596256:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596263:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.596266:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596274:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596286:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596293:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2dea2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596304:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.596306:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.596308:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.596613:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.596713:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.596720:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596730:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.596734:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.596738:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596759:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596767:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596774:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.596797:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045421.597140:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045421.597146:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.597154:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045421.597157:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.597166:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784045421.597192:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.597199:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.597199:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597207:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.597210:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.597213:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dea9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597226:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597235:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.597238:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.597240:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.597241:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.597243:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597261:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597281:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784045421.597650:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.597656:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597665:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.597668:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.597673:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597681:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597688:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597695:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597711:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784045421.597719:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045421.597722:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597734:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.597737:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597744:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597755:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597762:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a1198f/0xdb5b5ff6a2d2deb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597776:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.597779:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597786:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.597789:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597796:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597806:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597817:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032f8ac56/0xdb5b5ff6a2d2deb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.597850:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.597852:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.597853:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.598561:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.610189:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.610206:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610237:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.610242:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.610248:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610264:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610274:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610281:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610303:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.610317:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.610330:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610338:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.610344:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610353:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610370:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610377:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c8e5ab/0xdb5b5ff6a2d2debe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.610398:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.610400:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.610401:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.618488:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.618503:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618521:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.618526:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.618533:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618561:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618573:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618581:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618616:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.618637:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.618644:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618653:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.618658:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618668:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618686:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618695:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002467d2c9/0xdb5b5ff6a2d2dec5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.618727:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.618728:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.618731:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.620115:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.620126:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620141:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.620146:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.620151:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620163:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620172:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620180:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620224:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.620241:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.620246:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620267:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.620271:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620279:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620295:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620303:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf864cee/0xdb5b5ff6a2d2decc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.620322:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.620324:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.620326:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.628234:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.628250:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628268:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.628273:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.628279:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628295:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628312:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628320:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628338:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.628352:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.628357:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628365:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.628369:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628377:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628394:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628400:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcccaa1b/0xdb5b5ff6a2d2ded3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628415:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.628422:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.628424:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.628884:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.628891:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628900:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.628903:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.628908:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628916:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628924:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628932:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628946:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.628955:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.628959:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628965:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.628968:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628985:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.628996:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629003:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063181294/0xdb5b5ff6a2d2deda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629016:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.629018:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.629019:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.629462:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.629468:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629478:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.629481:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.629485:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629494:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629502:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629517:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629542:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784045421.629945:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.629951:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629959:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.629962:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.629965:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629974:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629980:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.629987:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630000:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784045421.630009:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045421.630013:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630025:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.630029:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630037:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630050:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630058:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7d0f75/0xdb5b5ff6a2d2dee1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630073:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.630076:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630082:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d360400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.630084:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630091:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630100:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630113:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c249172/0xdb5b5ff6a2d2dee8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630127:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.630129:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.630130:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.630333:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.630545:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.630552:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630560:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.630563:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.630567:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630576:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630584:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630591:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.630611:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045421.630677:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045421.630682:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.630690:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045421.630693:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.630701:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.630714:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.630722:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2deef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.630736:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.630737:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045421.630744:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045421.631016:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045421.631027:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.631035:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1784045421.631039:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045421.631043:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.631053:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.631060:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.631067:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.631088:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045421.631456:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.631462:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.631470:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.631474:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.631481:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.631497:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.631504:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056311179/0xdb5b5ff6a2d2def6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.631532:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.631535:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.631537:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784045421.636263:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1784045421.639620:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.639635:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.639655:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.639660:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.639667:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.639683:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.639693:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.639699:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.639730:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.639936:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.639945:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.639954:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.639958:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.639968:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.639991:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.639999:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2defd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.640015:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.640017:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.640019:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.640258:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.640265:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.640274:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.640277:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.640282:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.640299:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.640856:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.640866:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.640890:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045421.641006:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.641015:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.641023:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.641027:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.641035:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.641049:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.641057:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2df04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.641074:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.641075:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.641077:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.642085:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.642095:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.642111:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.642116:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.642123:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.642134:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.642144:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.642163:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.642684:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.644893:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.644907:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.644921:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.644926:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.644936:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.644957:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.644964:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2df0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.644995:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.644997:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.644999:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.646783:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.646794:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.646813:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.646818:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.646845:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.646859:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.646868:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.646876:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.646895:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045421.648179:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.648190:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.648240:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.648245:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.648257:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.648277:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.648285:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089db0516/0xdb5b5ff6a2d2df12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.648306:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.648308:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.648309:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.653742:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.653762:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.653788:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.653793:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.653801:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.653817:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.653843:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.653852:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.653873:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.656310:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.656325:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.656339:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.656344:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.656355:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.656379:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.656386:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2df19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.656411:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.656412:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.656414:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.657709:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.657722:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.657739:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.657744:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.657753:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.657767:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.657791:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.657798:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.657903:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784045421.661200:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.661224:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.661242:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.661247:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.661253:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.661268:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.661279:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.661287:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.664886:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045421.664902:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.664916:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.664921:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.664932:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.664971:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.664978:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001509a7ff/0xdb5b5ff6a2d2df20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.665224:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.665232:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.665239:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.665256:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.665259:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.665265:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.665276:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.665282:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2df27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.665296:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.665297:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.665299:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.665904:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.665911:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.665924:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.665929:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.665936:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.665946:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.665955:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.665962:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.665984:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045421.666139:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045421.666144:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.666152:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045421.666155:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.666164:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.666186:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.666192:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2df2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.666227:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.666229:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045421.666231:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.666286:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.666771:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.666777:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.666788:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.666796:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.666802:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.666812:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.666821:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.668716:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.668755:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045421.671676:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.671693:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.671709:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.671715:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.671727:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.671753:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.671761:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2df35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.671795:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.671814:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.671816:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.675391:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.675404:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.675421:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.675425:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.675432:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.675446:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.675456:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.675471:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.675495:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045421.677792:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.677807:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.677822:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.677842:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.677853:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.677876:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.677884:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2df3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.677910:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.677912:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.677914:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.679356:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.679368:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.679386:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.679391:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.679398:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.679411:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.679422:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.679429:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.679452:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045421.679966:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.679973:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.679983:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.679988:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.680019:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.680037:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.680045:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2df43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.680065:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.680067:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.680069:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045421.683526:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045421.683542:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.683580:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1784045421.683585:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.683592:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.683608:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.683618:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.683625:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.683651:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784045421.683902:0:14873:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1784045421.683999:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14259:x1870706829785344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 139058us (139607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045421.684035:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1784045421.684210:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045421.684229:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.684238:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045421.684243:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.684253:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.684272:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.684290:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2df4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.684308:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.684309:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045421.684311:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045421.684602:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1870706829785344:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784045421.684617:0:14259:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1784045421.684664:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1870706829785472:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784045421.684701:0:14259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045421.684740:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045421.685408:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785472 00000100:00100000:0.0:1784045421.685416:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785472 00000100:00100000:0.0:1784045421.685498:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045421.685508:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14259:x1870706829785472:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784045421.685551:0:14875:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1784045421.698767:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14259:x1870706829785472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13252us (14057us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784045421.698790:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045421.699038:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14259:1870706829785472:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784045421.699056:0:14259:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1784045422.114984:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045423.139084:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045424.162075:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784045424.762693:0:15539:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784045424.762697:0:15539:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1784045424.762823:0:15539:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8aa91077f000 00000020:01000004:0.0:1784045424.763574:0:15539:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784045424.763590:0:15539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1784045424.763606:0:15539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8aa9060c4d40) 00000020:00000080:0.0:1784045424.763623:0:15539:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784045424.782153:0:15539:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784045424.782470:0:15539:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784045424.783951:0:15539:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784045424.785187:0:15539:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784045424.785421:0:15539:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784045424.786266:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 370: rc = 0 00100000:10000000:2.0:1784045424.786368:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 370: rc = 0 00100000:10000000:2.0:1784045424.786574:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 370: rc = 0 00100000:10000000:2.0:1784045424.788441:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 640: rc = 0 00100000:10000000:2.0:1784045424.788736:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:2.0:1784045424.789684:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:2.0:1784045424.790786:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:2.0:1784045424.791089:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 640: rc = 0 00100000:10000000:2.0:1784045424.791536:0:15539:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 640: rc = 0 00000020:00000080:2.0:1784045424.793241:0:15539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784045424.793322:0:15539:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045424.793334:0:15539:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdb5b5ff6a2d2df58 00000020:01000004:2.0:1784045424.793342:0:15539:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784045424.793372:0:15539:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784045424.793375:0:15539:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784045424.793382:0:15539:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784045424.793405:0:15539:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784045424.793410:0:15539:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784045424.804371:0:15539:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784045424.804451:0:15539:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.158@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1784045424.804457:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784045424.804458:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045424.804460:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045424.804461:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045424.804462:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045424.804464:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045424.804465:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045424.804467:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045424.804468:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045424.804472:0:15539:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1784045424.804474:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045424.804476:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045424.804477:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045424.804483:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045424.804484:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045424.804485:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045424.804485:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045424.804486:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045424.804488:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045424.804515:0:15539:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784045424.804536:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784045424.804636:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.804803:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.805387:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785600 00000100:00100000:0.0:1784045424.805397:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785600 00000100:00100000:0.0:1784045424.805494:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784045424.805504:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:15539:x1870706829785600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784045424.805548:0:14229:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784045424.805552:0:14229:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1784045424.805556:0:14229:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784045424.813773:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:15539:x1870706829785600:12345-0@lo:253:mount.lustre.0 Request processed in 8261us (9127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.813788:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784045424.813933:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785600:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784045424.813950:0:15539:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784045424.814054:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045424.814056:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045424.814058:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045424.814059:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045424.814060:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045424.814062:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045424.814063:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045424.814065:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045424.814066:0:15539:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784045424.814089:0:15539:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8aa91077f000 from lustre-OST0001 10000000:01000000:3.0:1784045424.814116:0:15539:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784045424.814118:0:15539:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784045424.814126:0:15539:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8aa907feb380 local copy 00010000:00010000:3.0:1784045424.814136:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.814371:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045424.814410:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.814452:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa33d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.814574:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785728 00000100:00100000:0.0:1784045424.814581:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785728 00000100:00100000:0.0:1784045424.814623:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045424.814633:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:15539:x1870706829785728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045424.814788:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:15539:x1870706829785728:12345-0@lo:501:mount.lustre.0 Request processed in 156us (378us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045424.814796:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784045424.815045:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785728:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784045424.815060:0:15539:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784045424.815218:0:15539:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784045424.815226:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.815235:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942045c00/0xdb5b5ff6a2d2dd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dd0c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045424.815316:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8aa91077f000 10000000:01000000:3.0:1784045424.815322:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784045424.815327:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784045424.815329:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045424.815334:0:15539:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784045424.815337:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784045424.815361:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.815370:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.815380:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.815395:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045424.815423:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.815497:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90aa33d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.815646:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785856 00000100:00100000:0.0:1784045424.815658:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785856 00000100:00100000:0.0:1784045424.815725:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045424.815732:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:15539:x1870706829785856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045424.815742:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045424.815753:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e33c00/0xdb5b5ff6a2d2df66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2df5f expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.815774:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e33c00/0xdb5b5ff6a2d2df66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df5f expref: 17 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.815785:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e33c00/0xdb5b5ff6a2d2df66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df5f expref: 17 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.815794:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e33c00, rc 0) 00000100:00100000:0.0:1784045424.815854:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829785856:12345-0@lo:101:mount.lustre.0 Request processed in 122us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.815861:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784045424.815935:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045424.815949:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df66 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.815966:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2df66 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045424.816594:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1784045424.817434:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045424.817702:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1784045424.817750:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1784045424.817787:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1784045424.817907:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1784045424.817950:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1784045424.817986:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1784045424.818053:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1784045424.818062:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1784045424.818141:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045424.818220:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.819153:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.819662:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829785984 00000100:00100000:3.0:1784045424.819670:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829785984 00000100:00100000:3.0:1784045424.819718:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784045424.819728:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829785984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045424.820682:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829785984:12345-0@lo:501:mount.lustre.0 Request processed in 952us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.820691:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784045424.820780:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829785984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045424.821119:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045424.821177:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.821251:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.821381:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786112 00000100:00100000:2.0:1784045424.821387:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786112 00000100:00100000:2.0:1784045424.821456:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045424.821464:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045424.821790:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786112:12345-0@lo:503:mount.lustre.0 Request processed in 325us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.821797:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045424.821888:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784045424.822803:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784045424.822914:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045424.823025:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.823667:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.823728:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786240 00000100:00100000:3.0:1784045424.823734:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786240 00000100:00100000:3.0:1784045424.823766:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045424.823774:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045424.824022:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786240:12345-0@lo:502:mount.lustre.0 Request processed in 248us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.824030:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045424.824234:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045424.824631:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784045424.824688:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784045424.824723:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784045424.824770:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784045424.824804:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784045424.824888:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784045424.825072:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784045424.825119:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784045424.825183:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784045424.825221:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045424.825416:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.825451:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.825531:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786368 00000100:00100000:3.0:1784045424.825538:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786368 00000100:00100000:3.0:1784045424.825568:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784045424.825576:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045424.825903:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786368:12345-0@lo:502:mount.lustre.0 Request processed in 325us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.825911:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045424.827562:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045424.827691:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1784045424.827705:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1784045424.829111:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784045424.829121:0:15540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784045424.829128:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.829130:0:15540:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784045424.829135:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045424.829151:0:15540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8aa907f419c0) 00000020:00000080:3.0:1784045424.829184:0:15540:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784045424.829194:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784045424.829378:0:15540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa91077f000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784045424.829386:0:15540:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045424.829393:0:15540:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdb5b5ff6a2d2df74 00010000:00010000:3.0:1784045424.834608:0:15540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1784045424.835409:0:15540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1784045424.840718:0:15540:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1784045424.842659:0:15540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784045424.842670:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045424.842677:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.842679:0:15540:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784045424.842683:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045424.842687:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.842688:0:15540:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784045424.842691:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784045424.842693:0:15540:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784045424.842695:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045424.842698:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.842699:0:15540:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784045424.842701:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045424.842703:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.842704:0:15540:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784045424.842707:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784045424.842759:0:15540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045424.842763:0:15540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.842764:0:15540:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784045424.842767:0:15540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1784045424.842967:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1784045424.842995:0:15539:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784045424.843016:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df66 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.843029:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942173e00/0xdb5b5ff6a2d2df5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df66 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045424.843037:0:15539:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa91077f000 from 1 10000000:01000000:1.0:1784045424.843040:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045424.843078:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.843086:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.843096:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.843120:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045424.843207:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.843260:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.843491:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786496 00000100:00100000:3.0:1784045424.843499:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786496 00000100:00100000:3.0:1784045424.843546:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784045424.843556:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93773a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:15539:x1870706829786496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045424.843569:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045424.843582:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2df7b expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.843604:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.843622:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.843630:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173000, rc 0) 00000100:00100000:3.0:1784045424.843671:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93773a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786496:12345-0@lo:101:mount.lustre.0 Request processed in 117us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.843679:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784045424.843890:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045424.843905:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.843915:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045424.845429:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784045424.845916:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045424.846496:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784045424.846559:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784045424.846629:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784045424.846638:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784045424.846718:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045424.846785:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.846930:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.855577:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786624 00000100:00100000:2.0:1784045424.855592:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786624 00000100:00100000:2.0:1784045424.855652:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784045424.855663:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93773b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045424.856175:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93773b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786624:12345-0@lo:501:mount.lustre.0 Request processed in 512us (9388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.856184:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784045424.856300:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045424.856350:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045424.856400:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.856435:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.856587:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786752 00000100:00100000:2.0:1784045424.856592:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786752 00000100:00100000:2.0:1784045424.856632:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045424.856640:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93773a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045424.856782:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93773a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786752:12345-0@lo:503:mount.lustre.0 Request processed in 142us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.856789:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784045424.856933:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784045424.858768:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784045424.858867:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045424.858932:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.858982:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.859270:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829786880 00000100:00100000:0.0:1784045424.859277:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829786880 00000100:00100000:0.0:1784045424.859320:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784045424.859330:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93773b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045424.859696:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93773b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829786880:12345-0@lo:502:mount.lustre.0 Request processed in 367us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.859704:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784045424.860024:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829786880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045424.860387:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784045424.860443:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784045424.868392:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784045424.868677:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784045424.868719:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784045424.868769:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784045424.868808:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784045424.869043:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784045424.869099:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045424.869199:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.869359:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.872126:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787008 00000100:00100000:2.0:1784045424.872150:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787008 00000100:00100000:2.0:1784045424.872222:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784045424.872233:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829787008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045424.872696:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829787008:12345-0@lo:502:mount.lustre.0 Request processed in 463us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.872705:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784045424.872800:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045424.873192:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1784045424.873207:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784045424.875775:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045424.875788:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.875791:0:15544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784045424.875797:0:15544:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa91077f000 00000020:00000080:3.0:1784045424.875800:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784045424.875811:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045424.875814:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.875815:0:15544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784045424.875818:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045424.875820:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.875821:0:15544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045424.875825:0:15544:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8aa91077f000 00000020:00000080:3.0:1784045424.875940:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784045424.876130:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045424.876135:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.876137:0:15544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784045424.876139:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045424.876142:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045424.876144:0:15544:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784045424.876148:0:15544:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8aa91077f000 00000020:00000080:3.0:1784045424.876150:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045424.896249:0:15544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045424.896262:0:15544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045424.896265:0:15544:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784045424.896269:0:15544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1784045424.896453:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784045424.896481:0:15539:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045424.896505:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.896518:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045424.896563:0:15539:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784045424.896567:0:15539:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8aa91077f000 10000000:01000000:1.0:1784045424.896570:0:15539:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8aa91077f000 10000000:01000000:1.0:1784045424.896575:0:15539:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045424.896581:0:15539:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8aa91077f000 from 1 10000000:01000000:1.0:1784045424.896591:0:15539:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045424.896631:0:15539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.896641:0:15539:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.896651:0:15539:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.896676:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045424.896755:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.896797:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.897088:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787136 00000100:00100000:0.0:1784045424.897095:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787136 00000100:00100000:0.0:1784045424.897180:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045424.897189:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829787136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045424.897209:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045424.897221:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2df90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2df89 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.897243:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2df90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df89 expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.897253:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa939e32400/0xdb5b5ff6a2d2df90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df89 expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.897261:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa939e32400, rc 0) 00000100:00100000:0.0:1784045424.897311:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787136:12345-0@lo:101:mount.lustre.0 Request processed in 123us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.897318:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784045424.897394:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045424.897409:0:15539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df90 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.897419:0:15539:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2df90 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045424.898094:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1784045424.898490:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045424.898755:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784045424.898802:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784045424.898864:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784045424.898914:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784045424.901086:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784045424.901244:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784045424.901286:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784045424.901323:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784045424.901406:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784045424.901445:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784045424.902334:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784045424.902409:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784045424.902447:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784045424.902482:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784045424.902529:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784045424.902581:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784045424.902617:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784045424.902666:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784045424.902704:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784045424.902738:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784045424.902799:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784045424.902873:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784045424.902911:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784045424.905764:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784045424.906268:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1784045424.906314:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1784045424.906379:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1784045424.906420:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1784045424.906456:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1784045424.906502:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1784045424.906540:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1784045424.906593:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1784045424.906627:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1784045424.906676:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1784045424.906714:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1784045424.906765:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1784045424.906803:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1784045424.909206:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1784045424.909223:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1784045424.911269:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045424.911372:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.911413:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa92d10fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.912019:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787264 00000100:00100000:2.0:1784045424.912029:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787264 00000100:00100000:2.0:1784045424.912089:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784045424.912098:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045424.912625:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787264:12345-0@lo:501:mount.lustre.0 Request processed in 527us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.912634:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784045424.912772:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045424.912823:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045424.912891:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.912919:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.913369:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787392 00000100:00100000:3.0:1784045424.913375:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787392 00000100:00100000:3.0:1784045424.913426:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784045424.913434:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045424.913604:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787392:12345-0@lo:503:mount.lustre.0 Request processed in 170us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.913611:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045424.913625:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784045424.915518:0:15539:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784045424.915620:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045424.915691:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.915792:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.919606:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787520 00000100:00100000:2.0:1784045424.919621:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787520 00000100:00100000:2.0:1784045424.919697:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784045424.919707:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045424.920716:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787520:12345-0@lo:502:mount.lustre.0 Request processed in 1006us (5020us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.920728:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784045424.922223:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784045424.923182:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784045424.923257:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1784045424.923567:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1784045424.930264:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1784045424.930344:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1784045424.930643:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1784045424.930680:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1784045424.930716:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1784045424.930767:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784045424.930805:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784045424.930908:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784045424.931144:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784045424.931198:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784045424.931233:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784045424.931283:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784045424.931335:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784045424.931552:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784045424.931606:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784045424.931642:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784045424.931675:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784045424.931725:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784045424.931762:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784045424.931799:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784045424.932046:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784045424.932085:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1784045424.932120:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1784045424.932183:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1784045424.932222:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1784045424.932259:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1784045424.932312:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1784045424.932348:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1784045424.932590:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1784045424.932644:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1784045424.932694:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1784045424.932732:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1784045424.932797:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1784045424.933118:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1784045424.933170:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1784045424.933222:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1784045424.933260:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1784045424.933310:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045424.934142:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.934265:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.936563:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787648 00000100:00100000:3.0:1784045424.936578:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787648 00000100:00100000:0.0:1784045424.936713:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784045424.936724:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045424.937085:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829787648:12345-0@lo:502:mount.lustre.0 Request processed in 361us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.937094:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784045424.937369:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829787648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045424.937490:0:15539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1784045424.937506:0:15539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784045424.938938:0:15549:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784045424.939058:0:15549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8aa93b594d40) 00000020:00000080:2.0:1784045424.939083:0:15549:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1784045424.939284:0:15549:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8aa91077f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784045424.939288:0:15549:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8aa91077f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784045424.939291:0:15549:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8aa91077f000 3 00010000:00080000:2.0:1784045424.939319:0:15549:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8aa80305d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.158@tcp at head 00010000:00010000:2.0:1784045424.943925:0:15549:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1784045424.944045:0:15549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784045424.944083:0:15549:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784045424.944096:0:15549:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdb5b5ff6a2d2df9e 00000100:00080000:2.0:1784045424.944107:0:15549:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045424.944112:0:15549:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8aa80305d000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1784045424.944147:0:15549:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa93f739500 x1870706829787776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045424.944186:0:15549:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1784045424.944397:0:15549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:0.0:1784045424.944789:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045424.944794:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784045424.944797:0:36:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045424.944802:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1784045424.944806:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1784045424.944810:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa93f7c5000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045424.944825:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937d34a80 x1870706829788032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045424.944900:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829788160:0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.944978:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.945013:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045424.945020:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829787904:0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.945046:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.945085:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829788288:0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.945108:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.945140:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788160 00000100:00100000:0.0:1784045424.945146:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788160 00000100:00100000:0.0:1784045424.945196:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788288 00000100:00100000:0.0:1784045424.945199:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788288 00000100:00100000:0.0:1784045424.945228:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045424.945236:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829788160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.945284:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829788160:12345-0@lo:400:kworker.0 Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.945291:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045424.945305:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045424.945311:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829788288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.945342:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829788288:12345-0@lo:400:kworker.0 Request processed in 31us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.945348:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045424.945381:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787904 00000100:00100000:0.0:1784045424.945385:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787904 00000100:00100000:0.0:1784045424.945411:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045424.945418:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1870706829787904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.945447:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1870706829787904:12345-0@lo:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.945453:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1784045424.945474:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045424.945478:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784045424.945508:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937d37b80 x1870706829788288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045424.945534:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829788288:0@lo:400:kworker.0 00000100:00100000:0.0:1784045424.945567:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829787904:0@lo:400:kworker.0 00010000:00080000:0.0:1784045424.945576:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa937d36a00 x1870706829788160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045424.945584:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829788160:0@lo:400:kworker.0 00000020:01000000:0.0:1784045424.945604:0:15539:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784045424.945633:0:15539:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045424.945645:0:15539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df90 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.945655:0:15539:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa900030e00/0xdb5b5ff6a2d2df89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2df90 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784045424.945695:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784045424.945698:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045424.945700:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045424.945701:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045424.945702:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045424.945703:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045424.945705:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045424.945706:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045424.945707:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045424.945711:0:15539:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1784045424.945713:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045424.945715:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045424.945716:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045424.945717:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045424.945718:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045424.945720:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045424.945720:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045424.945726:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045424.945726:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045424.945741:0:15539:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784045424.945752:0:15539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829788416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045424.945784:0:15539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.945809:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788416 00000100:00100000:0.0:1784045424.945813:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788416 00000100:00100000:0.0:1784045424.945863:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784045424.945870:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:15539:x1870706829788416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784045424.945890:0:14231:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1784045424.945903:0:14231:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784045424.946467:0:15539:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93ae0bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.946769:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829787776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784045424.946812:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.946855:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829788032:0@lo:8:kworker.0 00000100:00100000:3.0:1784045424.946881:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.948273:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788032 00000100:00100000:0.0:1784045424.948285:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788032 00000100:00100000:0.0:1784045424.948329:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045424.948337:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3317:x1870706829788032:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1784045424.948537:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3317:x1870706829788032:12345-0@lo:8:kworker.0 Request processed in 198us (1653us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784045424.948545:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045424.948606:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045424.948614:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045424.948619:0:3317:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784045424.948622:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829788032:0@lo:8:kworker.0 00000100:00100000:0.0:1784045424.948658:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829787776 00000100:00100000:0.0:1784045424.948663:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829787776 00000100:00100000:0.0:1784045424.948690:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045424.948695:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1870706829787776:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1784045424.948713:0:15092:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1784045424.948762:0:15092:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdb5b5ff6a2d2dfa5 00000004:00100000:0.0:1784045424.948779:0:15092:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045424.948812:0:15092:0:(import.c:65:import_set_state_nolock()) ffff8aa80304e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045424.948892:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1870706829787776:12345-0@lo:38:llog_process_th.0 Request processed in 195us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.948899:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784045424.948937:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8aa93f739500 x1870706829787776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045424.948947:0:3317:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045424.948952:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784045424.948959:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784045424.948964:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784045424.948966:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa80305d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045424.948971:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1870706829787776:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1784045424.974028:0:14231:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784045424.974050:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784045424.974324:0:14252:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784045424.974329:0:14252:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784045424.974520:0:14252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.974539:0:14252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 19 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.974549:0:14252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.974592:0:14252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 19 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.974608:0:14252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 19 pid: 14229 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.974623:0:14252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1870706829788544:0@lo:104: 00000100:00100000:3.0:1784045424.974701:0:14252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.974799:0:14252:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9061f1840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.974886:0:14219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788544 00000100:00100000:2.0:1784045424.974894:0:14219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788544 00000100:00100000:2.0:1784045424.974946:0:14219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045424.974955:0:14219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14252:x1870706829788544:12345-0@lo:104: 00010000:00010000:2.0:1784045424.974969:0:14219:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.975024:0:14219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784045424.975031:0:14219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:14252:x1870706829788544:12345-0@lo:104: Request processed in 77us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.975039:0:14219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045424.975080:0:14252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14252:1870706829788544:0@lo:104: 00010000:00010000:2.0:1784045424.975108:0:14252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.975668:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045424.975679:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.975690:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361200 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:0.0:1784045424.975695:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.975705:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045424.975714:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045424.975733:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045424.975773:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.975779:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045424.975810:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.975818:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa92d361200/0xdb5b5ff6a2d2de7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de86 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.975852:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1784045424.975867:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045424.975870:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3320:1870706829788672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045424.975871:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045424.975874:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045424.975914:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045424.976883:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788672 00000100:00100000:0.0:1784045424.976891:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788672 00010000:00010000:0.0:1784045424.976919:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 20 pid: 14229 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.976949:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045424.976956:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+20:3320:x1870706829788672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045424.976969:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045424.976974:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 20 pid: 14229 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.976986:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 20 pid: 14229 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977001:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173c00/0xdb5b5ff6a2d2de86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de7f expref: 20 pid: 14229 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977026:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977034:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784045424.977048:0:14223:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002719736s 00010000:00010000:0.0:1784045424.977053:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977059:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977067:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977074:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977080:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045424.977084:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977092:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977115:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.977125:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045424.977194:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3320:x1870706829788672:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.977201:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045424.978384:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3320:1870706829788672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045424.978660:0:14252:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.978672:0:14252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.978680:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942172c00/0xdb5b5ff6a2d2dfac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.989232:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:15539:x1870706829788416:12345-0@lo:253:mount.lustre.0 Request processed in 43346us (43431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.989249:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784045424.989616:0:15539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ecfa0ba9-cdb8-42f8-923d-132e8368012c:15539:1870706829788416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784045424.989655:0:15539:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784045424.989659:0:15539:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045424.989661:0:15539:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045424.989663:0:15539:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045424.989664:0:15539:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045424.989665:0:15539:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045424.989667:0:15539:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045424.989668:0:15539:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045424.989670:0:15539:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045424.989671:0:15539:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784045424.989690:0:15539:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784045425.004470:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045425.004662:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045425.004827:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045425.005016:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784045425.005180:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784045425.005420:0:15539:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784045425.007082:0:15539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784045425.120694:0:15539:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784045425.120706:0:15539:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784045425.120750:0:15539:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784045425.120810:0:15539:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784045425.120822:0:15539:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784045425.120881:0:15539:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1784045425.199883:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784045426.206795:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1784045426.207229:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784045426.209615:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045426.594988:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045426.595009:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829788800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045426.595112:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045426.595194:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788800 00000100:00100000:3.0:1784045426.595203:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788800 00000100:00100000:3.0:1784045426.595261:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045426.595271:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829788800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045426.595314:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784045426.595364:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829788800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.595385:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1784045426.595407:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045426.595436:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1784045426.595475:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829788800:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784045426.916016:0:14233:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784045426.916028:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8aa939d58800 from 8 10000000:01000000:3.0:1784045426.916036:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784045426.916173:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.916188:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.916203:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.916233:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829788928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045426.916308:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045426.916525:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941d99480 going to sleep for 11 seconds 00000100:00100000:2.0:1784045426.916743:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829788928 00000100:00100000:2.0:1784045426.916754:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829788928 00000100:00100000:2.0:1784045426.916823:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045426.917036:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829788928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045426.917055:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045426.917075:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2dfba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2dfb3 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.917184:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2dfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dfb3 expref: 19 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.917198:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa942173400/0xdb5b5ff6a2d2dfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2dfb3 expref: 19 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.917219:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173400, rc 0) 00000100:00100000:3.0:1784045426.917320:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829788928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.917329:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784045426.917515:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829788928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045426.917531:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dfba expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.917541:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2dfba expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.917768:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f73b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829789056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784045426.917815:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045426.919598:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941cd4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045426.919803:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789056 00000100:00100000:3.0:1784045426.919812:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789056 00000100:00100000:3.0:1784045426.919903:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784045426.919912:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829789056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784045426.919945:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784045426.919963:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784045426.919966:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1784045426.920063:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829789056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.920071:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784045426.920277:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f73b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829789056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784045426.920343:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045426.920352:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dfba expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.920419:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942172200/0xdb5b5ff6a2d2dfb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2dfba expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.235435:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045428.257247:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045429.281161:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045429.795477:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1784045430.181324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045430.181331:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1784045430.181336:0:37:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045430.181349:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8aa93f7c5000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1784045430.181369:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8aa937d37b80 x1870706829789440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045430.183554:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829789184:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.183626:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.183683:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829789824:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.183709:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.183734:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045430.183740:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829789696:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.183762:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.185330:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829789312:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.185386:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.185416:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045430.185424:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829789568:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.186672:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.186723:0:3317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829789440:0@lo:8:kworker.0 00000100:00100000:0.0:1784045430.186755:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045430.188425:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789824 00000100:00100000:2.0:1784045430.188438:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789824 00000100:00080000:3.0:1784045430.188665:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045430.189903:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789696 00000100:00100000:1.0:1784045430.189913:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789696 00000100:00100000:0.0:1784045430.190808:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789184 00000100:00100000:0.0:1784045430.190815:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789184 00000100:00100000:3.0:1784045430.191001:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789568 00000100:00100000:3.0:1784045430.191006:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789568 00000100:00100000:0.0:1784045430.191060:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045430.191082:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3319:x1870706829789184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.191178:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3319:x1870706829789184:12345-0@lo:400:kworker.0 Request processed in 110us (7551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045430.191185:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045430.191227:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789312 00000100:00100000:0.0:1784045430.191230:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789312 00000100:00100000:0.0:1784045430.191254:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789440 00000100:00100000:0.0:1784045430.191257:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789440 00000100:00100000:0.0:1784045430.191269:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045430.191276:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829789312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.191313:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829789312:12345-0@lo:400:kworker.0 Request processed in 38us (5927us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045430.191329:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045430.191342:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045430.191347:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1870706829789440:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784045430.191371:0:14874:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1784045430.191398:0:14874:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdb5b5ff6a2d2dfc1 00002000:00100000:0.0:1784045430.191411:0:14874:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8aa803048800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784045430.191415:0:14874:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784045430.191418:0:14874:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784045430.191735:0:14874:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045430.191758:0:14874:0:(import.c:65:import_set_state_nolock()) ffff8aa80304c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045430.191814:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1870706829789440:12345-0@lo:8:kworker.0 Request processed in 465us (5058us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045430.191821:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784045430.192222:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d37b80 x1870706829789440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045430.192240:0:3317:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784045430.192247:0:3317:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784045430.192252:0:3317:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784045430.192255:0:3317:0:(import.c:65:import_set_state_nolock()) ffff8aa93f7c5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784045430.192271:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784045430.192277:0:3317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1870706829789440:0@lo:8:kworker.0 00000004:00080000:0.0:1784045430.192332:0:14261:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1784045430.192352:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1870706829790080:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784045430.192386:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.192416:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa93017af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045430.192427:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045430.192436:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829789952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045430.192522:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.192556:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829789952 00000100:00100000:0.0:1784045430.192561:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829789952 00000100:00100000:0.0:1784045430.192593:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045430.192600:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829789952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045430.192623:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045430.192659:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829789952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045430.192665:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784045430.192693:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937743480 x1870706829789952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045430.192706:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829789952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045430.192729:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829789184:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.192757:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829789312:0@lo:400:kworker.0 00000100:00100000:0.0:1784045430.192772:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790080 00000100:00100000:0.0:1784045430.192774:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790080 00000100:00100000:2.0:1784045430.192988:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045430.192998:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829789824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045430.193040:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829789824:12345-0@lo:400:kworker.0 Request processed in 46us (9331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045430.193046:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045430.193274:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045430.193281:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14261:x1870706829790080:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784045430.196134:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045430.196151:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829789696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045430.196237:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1870706829789696:12345-0@lo:400:kworker.0 Request processed in 93us (12474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045430.196244:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045430.196262:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045430.196277:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829789568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045430.196322:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829789568:12345-0@lo:400:kworker.0 Request processed in 47us (9655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045430.196328:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1784045430.196597:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045430.196604:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045430.196607:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1784045430.196618:0:14260:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784045430.197039:0:14260:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464883207876ns, next at 0ns, rc = 0 00010000:00080000:0.0:1784045430.197883:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d36300 x1870706829789696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045430.197900:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1870706829789696:0@lo:400:kworker.0 00010000:00080000:0.0:1784045430.197915:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d34000 x1870706829789824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045430.197933:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829789824:0@lo:400:kworker.0 00002000:00080000:0.0:1784045430.198662:0:14874:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1784045430.198673:0:14874:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1784045430.198678:0:14874:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:1.0:1784045430.200695:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa937d37100 x1870706829789568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045430.200717:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829789568:0@lo:400:kworker.0 00002000:00010000:0.0:1784045430.221735:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.221747:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.221764:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.221769:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.221777:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.221806:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.221817:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.221826:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.223098:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784045430.223799:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.223807:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.223846:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.223852:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045430.223967:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045430.223975:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.223985:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045430.223990:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.224001:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.224023:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.224032:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4bcf1df/0xdb5b5ff6a2d2dfc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.224063:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045430.224065:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045430.224076:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.225228:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.225256:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.225268:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.225277:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.225303:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045430.225958:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045430.225966:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.225977:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045430.225981:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.225990:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.226009:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.226018:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a97a029c/0xdb5b5ff6a2d2dfcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.226036:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045430.226038:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045430.226040:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.230674:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.230690:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.230709:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.230715:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.230723:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.230739:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.230766:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.230775:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.230806:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045430.231551:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045430.231560:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.231570:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045430.231575:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.231587:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.231610:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.231618:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6488edf/0xdb5b5ff6a2d2dfd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.231636:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.231638:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.231640:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.231991:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.231999:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.232011:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.232016:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.232021:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.232032:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.232040:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.232048:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.232090:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045430.234008:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045430.234021:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.234047:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045430.234052:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.234063:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.234096:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.234105:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000028f26ce/0xdb5b5ff6a2d2dfdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.234134:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.234136:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.234137:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.234993:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.235003:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.235017:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.235021:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.235027:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.235040:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.235050:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.235058:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.235085:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045430.235218:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045430.235225:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.235233:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045430.235236:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.235245:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.235269:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.235277:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244cfeef/0xdb5b5ff6a2d2dfe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.235292:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.235294:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.235296:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.239238:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.239256:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239274:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.239287:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.239293:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239309:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239319:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239327:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239370:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045430.239383:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045430.239388:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239396:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045430.239400:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239409:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.239423:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.240258:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcb53c80/0xdb5b5ff6a2d2dfeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.240289:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.240291:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.240293:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.241177:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.241185:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.241198:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.241202:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.241209:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.241221:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.241231:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.241239:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.241257:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784045430.243963:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.243987:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244006:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.244010:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.244017:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244030:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244040:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244047:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244080:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784045430.244094:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045430.244100:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244108:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045430.244122:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244132:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244156:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244164:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe28858a/0xdb5b5ff6a2d2dff2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244181:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045430.244184:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244190:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045430.244193:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244201:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244210:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244216:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ae336cc/0xdb5b5ff6a2d2dff9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244229:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.244231:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.244238:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.244688:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.244693:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244702:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.244705:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.244710:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244718:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244726:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244733:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244746:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045430.244752:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045430.244755:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244762:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045430.244765:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244783:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244794:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244801:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a416b52c/0xdb5b5ff6a2d2e000 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.244814:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.244816:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.244817:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.245196:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.245201:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245209:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.245212:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.245216:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245224:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245232:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245245:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245259:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045430.245267:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045430.245270:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245276:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045430.245279:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245285:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245295:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245301:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fba4116d/0xdb5b5ff6a2d2e007 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245313:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.245314:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.245316:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.245683:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.245696:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245705:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.245708:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.245713:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245722:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245729:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245737:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245750:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045430.245757:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045430.245761:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245766:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e33200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045430.245769:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245776:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245793:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245800:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080a1d40f/0xdb5b5ff6a2d2e00e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.245813:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.245815:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.245817:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.248803:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.248816:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.248851:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.248856:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.248920:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.248935:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.248947:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.248955:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.248989:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045430.249582:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045430.249591:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.249611:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa939e32e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045430.249616:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.249625:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.249643:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.249651:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000879db5e6/0xdb5b5ff6a2d2e015 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045430.249673:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045430.249675:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045430.249677:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.251351:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.251363:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.251379:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.251384:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.251391:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.251404:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.251413:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.251421:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.251793:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.252230:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.252238:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.252247:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.252252:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.252262:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.252293:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.252300:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e01c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.252317:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.252318:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.252320:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.252614:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.252620:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.252631:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.252642:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.252649:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.252661:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.252669:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.252677:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.252701:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.253218:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.253224:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.253232:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.253235:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.253243:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.253255:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.253261:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e023 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.253288:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.253290:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.253291:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.253394:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.254541:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.254550:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.254565:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.254569:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.254575:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.254587:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.254596:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.254610:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.254662:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784045430.257386:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.257398:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.257416:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.257421:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.257428:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.257520:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.257532:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.257540:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260250:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045430.260265:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260279:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.260284:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260295:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260318:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260325:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e02a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260346:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.260350:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260356:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.260369:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260377:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260389:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.260397:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.260399:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.260400:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.264057:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784045430.264082:0:14874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e031 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.265143:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045430.275519:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045430.275533:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275552:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1784045430.275557:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045430.275563:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275578:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275588:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275608:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275630:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.275644:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.275650:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275657:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.275662:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275671:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275687:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275695:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf81cfaa/0xdb5b5ff6a2d2e038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.275711:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.275713:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.275715:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045430.276216:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045430.276229:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276238:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1784045430.276241:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045430.276245:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276254:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276260:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276266:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276281:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.276290:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.276293:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276299:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030a00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.276303:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276309:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276328:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276336:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e03f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276348:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.276350:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.276352:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045430.276744:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045430.276750:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276758:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1784045430.276761:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045430.276765:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276773:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276780:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276787:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276813:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.276822:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.276827:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276857:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.276861:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276869:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276882:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276889:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e046 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.276902:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.276903:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.276905:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045430.277286:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045430.277292:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277300:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1784045430.277308:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045430.277312:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277321:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277329:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277336:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277349:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.277356:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.277360:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277366:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.277370:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277377:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277387:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277404:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e1c047/0xdb5b5ff6a2d2e04d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277415:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.277417:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.277419:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784045430.277764:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784045430.277769:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277778:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1784045430.277781:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045430.277785:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277793:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277801:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277808:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277822:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.277850:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.277861:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277868:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.277871:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277878:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277888:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277895:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a0ce32e/0xdb5b5ff6a2d2e054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.277907:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.277909:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.277910:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784045430.280692:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1784045430.286702:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.286716:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.286736:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.286741:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.286746:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.286760:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.286770:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.286778:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.286813:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.287995:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.288005:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.288016:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.288021:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.288042:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.288061:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.288081:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3fa1902/0xdb5b5ff6a2d2e05b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.288103:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.288105:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.288106:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.289816:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.289844:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.290521:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.290529:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.290544:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.290559:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.290570:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.290578:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.290601:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045430.290978:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.290986:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.290995:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b000 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.291000:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.291008:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.291028:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.291049:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cbeaddd/0xdb5b5ff6a2d2e062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.291079:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.291081:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.291083:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.291808:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.291816:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.292600:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.292610:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.292616:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.292631:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.292641:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.292661:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.293541:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784045430.295643:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.295656:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.295673:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.295678:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.295684:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.295698:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.295707:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.295716:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296545:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045430.296554:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296563:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.296568:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296577:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296596:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296604:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e73151f/0xdb5b5ff6a2d2e069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296622:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.296626:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296640:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311ba00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.296643:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296650:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296659:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.296666:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.296667:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.296669:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.296758:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784045430.296765:0:14874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4ee76f6/0xdb5b5ff6a2d2e070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.297001:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045430.297653:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.297659:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.297672:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.297677:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.297682:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.297693:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.297701:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.297709:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.297772:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784045430.298216:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.298222:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.298232:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.298236:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.298247:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.298257:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.298265:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.298273:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298570:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045430.298579:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298588:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.298592:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298601:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298617:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298632:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b724bc04/0xdb5b5ff6a2d2e077 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298650:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045430.298654:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298660:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045430.298663:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298670:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298680:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045430.298688:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.298690:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.298691:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045430.300410:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784045430.300423:0:14874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e07e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045430.301246:0:14874:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784045430.301253:0:14874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.301266:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=464s v=(0 0) 00010000:00010000:0.0:1784045430.301270:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045430.301277:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.301290:0:14874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.301310:0:14874:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.301317:0:14874:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045430.301412:0:14874:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784045430.301597:0:14874:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1784045430.301694:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14261:x1870706829790080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108410us (109305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045430.301703:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045430.301755:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1870706829790080:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784045430.301770:0:14261:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1784045430.301816:0:14261:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1870706829790208:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784045430.302018:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045430.302052:0:14261:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9344ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045430.302080:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790208 00000100:00100000:0.0:1784045430.302087:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790208 00000100:00100000:0.0:1784045430.302123:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045430.302132:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14261:x1870706829790208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784045430.302173:0:14873:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1784045430.304634:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045430.304646:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.304658:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311ae00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045430.304663:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.304673:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.304695:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.304702:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088032823/0xdb5b5ff6a2d2e085 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045430.304735:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.304737:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.304739:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045430.306976:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045430.307061:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045430.313575:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14261:x1870706829790208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11435us (11548us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784045430.313591:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045430.316339:0:14261:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14261:1870706829790208:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784045430.316360:0:14261:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1784045431.329443:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045431.720067:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829790336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045431.720163:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045431.720257:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790336 00000100:00100000:2.0:1784045431.720265:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790336 00000100:00100000:2.0:1784045431.720309:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045431.720331:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829790336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045431.720373:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045431.720415:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829790336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045431.720422:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045431.720465:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829790336:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784045432.277566:0:15896:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784045432.367085:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045433.377077:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045434.408240:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045434.882222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045434.882402:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808824704 00000100:00100000:2.0:1784045434.882413:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808824704 00000100:00100000:2.0:1784045434.882463:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:2.0:1784045434.882472:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1870706808824704:12345-192.168.201.58@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784045434.882501:0:14230:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 9601e793-9924-4b38-b573-084004e89c20@192.168.201.58@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1784045434.882528:0:14230:0:(genops.c:1406:class_connect()) connect: client 9601e793-9924-4b38-b573-084004e89c20, cookie 0xdb5b5ff6a2d2e08c 00000100:00080000:2.0:1784045434.882674:0:14230:0:(import.c:65:import_set_state_nolock()) ffff8aa803059000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045434.882749:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+5:2359:x1870706808824704:12345-192.168.201.58@tcp:250:mount.lustre.0 Request processed in 276us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.882757:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1784045434.895214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045434.895346:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808824832 00000100:00100000:0.0:1784045434.895356:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808824832 00000100:00100000:0.0:1784045434.895418:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1784045434.895429:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+5:13704:x1870706808824832:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045434.895448:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045434.895468:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa80311aa00/0xdb5b5ff6a2d2e093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda0552180010c expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045434.895497:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311aa00/0xdb5b5ff6a2d2e093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180010c expref: 6 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045434.895510:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa80311aa00/0xdb5b5ff6a2d2e093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180010c expref: 6 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045434.895519:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311aa00, rc 0) 00000100:00100000:0.0:1784045434.895602:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+6:13704:x1870706808824832:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 174us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.895610:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:1.0:1784045434.897463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045434.897725:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808824960 00000100:00100000:0.0:1784045434.897735:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808824960 00000100:00100000:0.0:1784045434.897795:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:0.0:1784045434.897805:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+6:13704:x1870706808824960:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784045434.898370:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+6:13704:x1870706808824960:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 565us (913us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045434.898378:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:1.0:1784045434.906620:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045434.906720:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825088 00000100:00100000:2.0:1784045434.906730:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825088 00000100:00100000:2.0:1784045434.906796:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1784045434.906807:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+6:13704:x1870706808825088:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045434.906825:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045434.906881:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2e09a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda05521800113 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.906913:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2e09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800113 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.906945:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720400/0xdb5b5ff6a2d2e09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800113 expref: 7 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.906955:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720400, rc 0) 00000100:00100000:2.0:1784045434.907030:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+7:13704:x1870706808825088:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 224us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.907036:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1784045434.911724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045434.911879:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825216 00000100:00100000:0.0:1784045434.911903:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825216 00000100:00100000:0.0:1784045434.911962:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1784045434.911973:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+7:13704:x1870706808825216:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784045434.912281:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+8:13704:x1870706808825216:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 309us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.912289:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:1.0:1784045434.921757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045434.922542:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825344 00000100:00100000:3.0:1784045434.922553:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825344 00000100:00100000:3.0:1784045434.922614:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:3.0:1784045434.922624:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+8:13704:x1870706808825344:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784045434.923261:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+8:13704:x1870706808825344:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 636us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.923271:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:1.0:1784045434.935571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045434.937172:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825472 00000100:00100000:2.0:1784045434.937186:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825472 00000100:00100000:2.0:1784045434.937258:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:2.0:1784045434.937268:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+8:13723:x1870706808825472:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045434.937688:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+8:13723:x1870706808825472:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 420us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.937696:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:2.0:1784045434.961423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045434.961690:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825600 00000100:00100000:0.0:1784045434.961701:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825600 00000100:00100000:0.0:1784045434.961769:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:0.0:1784045434.961779:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+8:13723:x1870706808825600:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045434.962116:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+8:13723:x1870706808825600:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 337us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.962124:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:1.0:1784045434.968724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045434.969228:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825728 00000100:00100000:2.0:1784045434.969240:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825728 00000100:00100000:2.0:1784045434.969315:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:2.0:1784045434.969325:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+8:13704:x1870706808825728:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045434.969342:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045434.969360:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2e0a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda0552180013d expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.969391:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2e0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180013d expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.969417:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720200/0xdb5b5ff6a2d2e0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180013d expref: 9 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.969427:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720200, rc 0) 00000100:00100000:2.0:1784045434.969488:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+9:13704:x1870706808825728:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 164us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.969495:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1784045434.975011:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045434.975105:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825856 00000100:00100000:3.0:1784045434.975115:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825856 00000100:00100000:3.0:1784045434.975174:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:3.0:1784045434.975184:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+9:13704:x1870706808825856:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784045434.975212:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784045434.975237:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784045434.975242:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784045434.975246:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784045434.975249:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784045434.977103:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+9:13704:x1870706808825856:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 1909us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.977119:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:1.0:1784045434.980767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045434.980982:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808825984 00000100:00100000:0.0:1784045434.981003:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808825984 00000100:00100000:0.0:1784045434.981063:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:0.0:1784045434.981073:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93779b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+9:13704:x1870706808825984:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045434.981090:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045434.981110:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda05521800144 expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045434.981141:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 10 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045434.981171:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 10 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045434.981181:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311ac00, rc 0) 00000100:00100000:0.0:1784045434.981246:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93779b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+10:13704:x1870706808825984:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 174us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.981253:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:1.0:1784045434.986195:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045434.986290:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826112 00000100:00100000:0.0:1784045434.986299:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826112 00000100:00100000:0.0:1784045434.986354:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:0.0:1784045434.986363:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+10:13704:x1870706808826112:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784045434.986640:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+10:13704:x1870706808826112:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 278us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.986648:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1784045434.988778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045434.989174:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826240 00000100:00100000:2.0:1784045434.989183:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826240 00000100:00100000:2.0:1784045434.989241:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:2.0:1784045434.989250:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+10:13704:x1870706808826240:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784045434.989610:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+10:13704:x1870706808826240:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 360us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.989618:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:1.0:1784045434.993092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045434.993436:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826368 00000100:00100000:3.0:1784045434.993459:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826368 00000100:00100000:3.0:1784045434.993520:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1784045434.993530:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+10:13727:x1870706808826368:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045434.994948:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+10:13727:x1870706808826368:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 1413us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.994974:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:1.0:1784045435.006555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045435.006652:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826496 00000100:00100000:0.0:1784045435.006661:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826496 00000100:00100000:0.0:1784045435.006717:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784045435.006726:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+10:13727:x1870706808826496:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045435.007017:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+10:13727:x1870706808826496:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 290us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045435.007025:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784045435.011791:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045435.011888:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826624 00000100:00100000:3.0:1784045435.011899:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826624 00000100:00100000:3.0:1784045435.011952:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1784045435.011960:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1870706808826624:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784045435.012000:0:14236:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2e5d4df7-21bd-4c55-9ea9-223194ff0253@192.168.201.58@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1784045435.012049:0:14236:0:(genops.c:1406:class_connect()) connect: client 2e5d4df7-21bd-4c55-9ea9-223194ff0253, cookie 0xdb5b5ff6a2d2e0af 00000004:00100000:3.0:1784045435.012139:0:14236:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1784045435.012147:0:14236:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1784045435.074672:0:14236:0:(import.c:65:import_set_state_nolock()) ffff8aa90396b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045435.074892:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2359:x1870706808826624:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 62929us (63109us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045435.074905:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784045435.080294:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045435.080395:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826880 00000100:00100000:0.0:1784045435.080406:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826880 00000100:00100000:0.0:1784045435.080492:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1784045435.080519:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13704:x1870706808826880:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784045435.080577:0:15092:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784045435.080665:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13704:x1870706808826880:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 148us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045435.080674:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00080000:1.0:1784045435.081116:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045435.081274:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045435.081320:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808826752 00000100:00100000:0.0:1784045435.081326:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808826752 00000100:00100000:0.0:1784045435.081362:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784045435.081369:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:0:x1870706808826752:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784045435.081386:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784045435.081427:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:0:x1870706808826752:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045435.081433:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784045435.084218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045435.084443:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827008 00000100:00100000:0.0:1784045435.084451:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827008 00000100:00100000:0.0:1784045435.084506:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784045435.084515:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13704:x1870706808827008:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784045435.084611:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13704:x1870706808827008:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 96us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045435.084619:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784045435.087718:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045435.087877:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827136 00000100:00100000:0.0:1784045435.087887:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827136 00000100:00100000:0.0:1784045435.087939:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784045435.087947:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808827136:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784045435.087977:0:14874:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2e5d4df7-21bd-4c55-9ea9-223194ff0253@192.168.201.58@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1784045435.088042:0:14874:0:(genops.c:1406:class_connect()) connect: client 2e5d4df7-21bd-4c55-9ea9-223194ff0253, cookie 0xdb5b5ff6a2d2e0b6 00002000:00100000:0.0:1784045435.088055:0:14874:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e5d4df7-21bd-4c55-9ea9-223194ff0253/ffff8aa803049000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045435.088078:0:14874:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784045435.088186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045435.088226:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045435.088251:0:14875:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784045435.088259:0:14875:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784045435.088295:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827392 00000100:00100000:3.0:1784045435.088300:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827392 00000100:00100000:3.0:1784045435.088341:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784045435.088350:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13704:x1870706808827392:12345-192.168.201.58@tcp:33:mount.lustre.0 00002000:00080000:0.0:1784045435.088470:0:14874:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784045435.088499:0:14874:0:(import.c:65:import_set_state_nolock()) ffff8aa80304d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045435.088562:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2359:x1870706808827136:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 614us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045435.088571:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784045435.088587:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827264 00000100:00100000:0.0:1784045435.088590:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827264 00000100:00100000:0.0:1784045435.088602:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1784045435.088606:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808827264:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784045435.088621:0:14874:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2e5d4df7-21bd-4c55-9ea9-223194ff0253@192.168.201.58@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:0.0:1784045435.088641:0:14874:0:(genops.c:1406:class_connect()) connect: client 2e5d4df7-21bd-4c55-9ea9-223194ff0253, cookie 0xdb5b5ff6a2d2e0bd 00002000:00100000:0.0:1784045435.088647:0:14874:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e5d4df7-21bd-4c55-9ea9-223194ff0253/ffff8aa80304b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045435.088661:0:14874:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784045435.088782:0:14874:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045435.088799:0:14874:0:(import.c:65:import_set_state_nolock()) ffff8aa80304a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045435.088822:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2359:x1870706808827264:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 215us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045435.088864:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000004:00080000:3.0:1784045435.089340:0:14239:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 931us 00000004:00200000:3.0:1784045435.106439:0:14239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784045435.107000:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13704:x1870706808827392:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 18634us (18756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045435.107020:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784045435.297619:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829790464:0@lo:400:kworker.0 00000100:00100000:3.0:1784045435.297697:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.298000:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829790848:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298037:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.298083:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784045435.298090:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829790720:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298137:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.298169:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829791232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045435.298193:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.298223:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829790592:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298248:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.298268:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829791104:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298294:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.298342:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790848 00000100:00100000:2.0:1784045435.298349:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790848 00000100:00100000:2.0:1784045435.298389:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791104 00000100:00100000:2.0:1784045435.298392:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791104 00000100:00100000:2.0:1784045435.298422:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045435.298430:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829790848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298482:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870706829790848:12345-0@lo:400:kworker.0 Request processed in 51us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.298490:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045435.298507:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045435.298517:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829791104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298563:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829791104:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.298568:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045435.298591:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790720 00000100:00100000:2.0:1784045435.298594:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790720 00000100:00100000:2.0:1784045435.298618:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790592 00000100:00100000:2.0:1784045435.298621:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790592 00000100:00100000:2.0:1784045435.298641:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045435.298647:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1870706829790720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298674:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1870706829790720:12345-0@lo:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.298686:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045435.298697:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045435.298703:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829790592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298729:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829790592:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.298735:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045435.298750:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791232 00000100:00100000:2.0:1784045435.298753:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791232 00000100:00100000:2.0:1784045435.298775:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045435.298781:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1870706829791232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045435.298794:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045435.298825:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1870706829791232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.298859:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784045435.298879:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045435.298882:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045435.298885:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045435.298923:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829790592:0@lo:400:kworker.0 00010000:00080000:2.0:1784045435.298936:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa939f4ca80 x1870706829791104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045435.298945:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829791104:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.298991:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829790720:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.299007:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829791232:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784045435.299016:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa939f4c380 x1870706829790848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045435.299032:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870706829790848:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.299075:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790464 00000100:00100000:2.0:1784045435.299079:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790464 00000100:00100000:2.0:1784045435.299105:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784045435.299111:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3318:x1870706829790464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.299145:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3318:x1870706829790464:12345-0@lo:400:kworker.0 Request processed in 34us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.299151:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784045435.299194:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829790464:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.299203:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829790976:0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.299227:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.299255:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829790976 00000100:00100000:2.0:1784045435.299258:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829790976 00000100:00100000:2.0:1784045435.299283:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784045435.299289:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829790976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045435.299337:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829790976:12345-0@lo:400:kworker.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.299344:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1784045435.299360:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784045435.299375:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8aa939f4f800 x1870706829790976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045435.299385:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829790976:0@lo:400:kworker.0 00000100:00100000:3.0:1784045435.301071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045435.301104:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827520 00000100:00100000:3.0:1784045435.301111:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827520 00000100:00100000:3.0:1784045435.301155:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784045435.301164:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:13748:x1870706808827520:12345-192.168.201.58@tcp:101:mkdir.0 00010000:00010000:3.0:1784045435.301181:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045435.301218:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172e00/0xdb5b5ff6a2d2e0c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180016e expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045435.301293:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e0cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045435.301307:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e0cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045435.301321:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e0cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045435.301714:0:15092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784045435.301719:0:15092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045435.301847:0:15092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e0cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045435.301877:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172e00/0xdb5b5ff6a2d2e0c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180016e expref: 8 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045435.301907:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e0cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180016e expref: 7 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045435.301916:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:3.0:1784045435.301919:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045435.301923:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173200, rc 0) 00000100:00100000:3.0:1784045435.301990:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:13748:x1870706808827520:12345-192.168.201.58@tcp:101:mkdir.0 Request processed in 816us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045435.301998:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000001:00100000:0.0:1784045435.411196:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e5d4df7-21bd-4c55-9ea9-223194ff0253 00000001:00080000:0.0:1784045435.411215:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1784045435.411269:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1784045435.425726:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784045436.398708:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e5d4df7-21bd-4c55-9ea9-223194ff0253 00010000:00010000:0.0:1784045436.449073:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045436.833737:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045436.833760:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045436.833849:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045436.833915:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791360 00000100:00100000:1.0:1784045436.833922:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791360 00000100:00100000:1.0:1784045436.833983:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045436.833992:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829791360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045436.834028:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045436.834081:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829791360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045436.834089:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045436.834283:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829791360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045437.404274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045437.404455:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827648 00000100:00100000:3.0:1784045437.404465:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827648 00000100:00100000:3.0:1784045437.404543:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1784045437.404555:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:13801:x1870706808827648:12345-192.168.201.58@tcp:41:lfs.0 00000004:00000024:3.0:1784045437.404599:0:14237:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784045437.404695:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:13801:x1870706808827648:12345-192.168.201.58@tcp:41:lfs.0 Request processed in 142us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045437.404704:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:2.0:1784045437.404780:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045437.407913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.408063:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827776 00000100:00100000:0.0:1784045437.408073:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827776 00000100:00100000:0.0:1784045437.408139:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784045437.408149:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:13801:x1870706808827776:12345-192.168.201.58@tcp:13:lfs.0 00002000:00000024:0.0:1784045437.408173:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045437.408256:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:13801:x1870706808827776:12345-192.168.201.58@tcp:13:lfs.0 Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.408263:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00080000:2.0:1784045437.408394:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045437.411267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.411348:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808827904 00000100:00100000:2.0:1784045437.411358:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808827904 00000100:00100000:2.0:1784045437.411432:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045437.411443:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:13801:x1870706808827904:12345-192.168.201.58@tcp:13:lfs.0 00002000:00000024:2.0:1784045437.411482:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784045437.411561:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:13801:x1870706808827904:12345-192.168.201.58@tcp:13:lfs.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.411569:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00080000:0.0:1784045437.411877:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784045437.473013:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045437.685242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.685469:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828032 00000100:00100000:2.0:1784045437.685480:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828032 00000100:00100000:2.0:1784045437.685564:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:2.0:1784045437.685575:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+10:13831:x1870706808828032:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045437.685592:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045437.685612:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2e0d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda05521800175 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045437.685640:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2e0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800175 expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045437.685652:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721e00/0xdb5b5ff6a2d2e0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800175 expref: 11 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045437.685662:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721e00, rc 0) 00000100:00100000:2.0:1784045437.685724:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+11:13831:x1870706808828032:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 151us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.685732:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:3.0:1784045437.703182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.703293:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828160 00000100:00100000:2.0:1784045437.703316:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828160 00000100:00100000:2.0:1784045437.703381:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784045437.703393:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+11:13831:x1870706808828160:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784045437.704032:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+11:13831:x1870706808828160:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 639us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.704042:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:3.0:1784045437.718965:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.719157:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828288 00000100:00100000:2.0:1784045437.719168:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828288 00000100:00100000:2.0:1784045437.719236:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:2.0:1784045437.719247:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+11:13831:x1870706808828288:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784045437.719990:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+11:13831:x1870706808828288:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 741us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.719999:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:3.0:1784045437.729543:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.729954:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828416 00000100:00100000:2.0:1784045437.729965:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828416 00000100:00100000:2.0:1784045437.730025:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:2.0:1784045437.730034:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+11:13840:x1870706808828416:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045437.730377:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+11:13840:x1870706808828416:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 341us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.730386:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:3.0:1784045437.746917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.747457:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828544 00000100:00100000:2.0:1784045437.747467:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828544 00000100:00100000:2.0:1784045437.747544:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:2.0:1784045437.747555:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9124c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+11:13840:x1870706808828544:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045437.747874:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9124c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+11:13840:x1870706808828544:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 319us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.747890:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1784045437.755111:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.759889:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828672 00000100:00100000:0.0:1784045437.759906:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828672 00000100:00100000:0.0:1784045437.759994:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:0.0:1784045437.760006:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+11:13831:x1870706808828672:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045437.760023:0:14229:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045437.760044:0:14229:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa80311a800/0xdb5b5ff6a2d2e0d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda0552180019f expref: -99 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045437.760074:0:14229:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311a800/0xdb5b5ff6a2d2e0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180019f expref: 12 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045437.760086:0:14229:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa80311a800/0xdb5b5ff6a2d2e0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180019f expref: 12 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045437.760095:0:14229:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311a800, rc 0) 00000100:00100000:0.0:1784045437.760170:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+12:13831:x1870706808828672:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 165us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.760195:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:3.0:1784045437.780122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.780596:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828800 00000100:00100000:0.0:1784045437.780606:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828800 00000100:00100000:0.0:1784045437.780672:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:0.0:1784045437.780684:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+12:13831:x1870706808828800:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784045437.780710:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784045437.780747:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784045437.780751:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784045437.780754:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784045437.780756:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784045437.808739:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+12:13831:x1870706808828800:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 28039us (28608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.808755:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:3.0:1784045437.828384:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.828504:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808828928 00000100:00100000:2.0:1784045437.828514:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808828928 00000100:00100000:2.0:1784045437.828567:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:2.0:1784045437.828576:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+12:13831:x1870706808828928:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045437.828592:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045437.828607:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055218001a6 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045437.828633:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 13 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045437.828644:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 13 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045437.828653:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720c00, rc 0) 00000100:00100000:2.0:1784045437.828704:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+13:13831:x1870706808828928:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.828711:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:3.0:1784045437.837969:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.838079:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829056 00000100:00100000:0.0:1784045437.838089:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829056 00000100:00100000:0.0:1784045437.838152:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:0.0:1784045437.838162:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:13831:x1870706808829056:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784045437.838471:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:13831:x1870706808829056:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 309us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.838489:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:3.0:1784045437.846609:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.846714:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829184 00000100:00100000:0.0:1784045437.846724:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829184 00000100:00100000:0.0:1784045437.846801:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:0.0:1784045437.846811:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+13:13831:x1870706808829184:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784045437.847138:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+13:13831:x1870706808829184:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 327us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.847153:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:3.0:1784045437.855277:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.855542:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829312 00000100:00100000:2.0:1784045437.855552:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829312 00000100:00100000:2.0:1784045437.855614:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:2.0:1784045437.855623:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+13:13844:x1870706808829312:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045437.856178:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+13:13844:x1870706808829312:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 554us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.856187:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:3.0:1784045437.859571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.860180:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829440 00000100:00100000:2.0:1784045437.860191:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829440 00000100:00100000:2.0:1784045437.860302:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:2.0:1784045437.860314:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:13844:x1870706808829440:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045437.860576:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:13844:x1870706808829440:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 263us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.860585:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1784045437.890111:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.890229:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829568 00000100:00100000:2.0:1784045437.890238:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829568 00000100:00100000:2.0:1784045437.890285:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1784045437.890292:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2359:x1870706808829568:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784045437.890321:0:15092:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 261a809c-20e2-4e50-abff-b9519e12c29d@192.168.201.58@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1784045437.890593:0:15092:0:(genops.c:1406:class_connect()) connect: client 261a809c-20e2-4e50-abff-b9519e12c29d, cookie 0xdb5b5ff6a2d2e0e7 00000004:00100000:2.0:1784045437.890625:0:15092:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784045437.890806:0:15092:0:(import.c:65:import_set_state_nolock()) ffff8aa80305a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045437.891058:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:261a809c-20e2-4e50-abff-b9519e12c29d+6:2359:x1870706808829568:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 763us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.891067:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784045437.908796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045437.909008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.909109:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829696 00000100:00100000:0.0:1784045437.909119:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829696 00000100:00080000:1.0:1784045437.909249:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045437.909960:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829824 00000100:00100000:1.0:1784045437.909965:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829824 00000100:00100000:3.0:1784045437.910087:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:3.0:1784045437.910099:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+7:0:x1870706808829696:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784045437.910134:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784045437.910211:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+7:0:x1870706808829696:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 113us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045437.910219:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:3.0:1784045437.910238:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784045437.910244:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:13831:x1870706808829824:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784045437.910256:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784045437.910281:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:13831:x1870706808829824:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 37us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045437.910288:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784045437.914802:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045437.920519:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808829952 00000100:00100000:2.0:1784045437.920535:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808829952 00000100:00100000:2.0:1784045437.920607:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784045437.920618:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:13831:x1870706808829952:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784045437.920756:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:13831:x1870706808829952:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 140us (5963us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.920764:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1784045437.930245:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.930331:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045437.930516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045437.930655:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830336 00000100:00100000:3.0:1784045437.930666:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830336 00000100:00100000:3.0:1784045437.930722:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:3.0:1784045437.930732:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:261a809c-20e2-4e50-abff-b9519e12c29d+6:13831:x1870706808830336:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784045437.931096:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784045437.931270:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:261a809c-20e2-4e50-abff-b9519e12c29d+6:13831:x1870706808830336:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 538us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045437.931279:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1784045437.931693:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830080 00000100:00100000:2.0:1784045437.931699:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830080 00000100:00100000:2.0:1784045437.931736:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830208 00000100:00100000:2.0:1784045437.931741:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830208 00000100:00100000:2.0:1784045437.931769:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1784045437.931775:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1870706808830080:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784045437.931800:0:14874:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 261a809c-20e2-4e50-abff-b9519e12c29d@192.168.201.58@tcp t0 exp 0000000000000000 cur 472 last 0 00000100:00100000:0.0:1784045437.931903:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1784045437.931909:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1870706808830208:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784045437.931926:0:16011:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 261a809c-20e2-4e50-abff-b9519e12c29d@192.168.201.58@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1784045437.931959:0:16011:0:(genops.c:1406:class_connect()) connect: client 261a809c-20e2-4e50-abff-b9519e12c29d, cookie 0xdb5b5ff6a2d2e0f5 00002000:00100000:0.0:1784045437.931972:0:16011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 261a809c-20e2-4e50-abff-b9519e12c29d/ffff8aa80304a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045437.931984:0:16011:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784045437.932190:0:16011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045437.932217:0:16011:0:(import.c:65:import_set_state_nolock()) ffff8aa939db1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045437.932264:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:261a809c-20e2-4e50-abff-b9519e12c29d+6:2359:x1870706808830208:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 352us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.932271:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000020:00000080:2.0:1784045437.932421:0:14874:0:(genops.c:1406:class_connect()) connect: client 261a809c-20e2-4e50-abff-b9519e12c29d, cookie 0xdb5b5ff6a2d2e0ee 00002000:00100000:2.0:1784045437.932427:0:14874:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 261a809c-20e2-4e50-abff-b9519e12c29d/ffff8aa80305a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784045437.932433:0:14874:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784045437.932685:0:14874:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784045437.932701:0:14874:0:(import.c:65:import_set_state_nolock()) ffff8aa80305f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045437.932729:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:261a809c-20e2-4e50-abff-b9519e12c29d+6:2359:x1870706808830080:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 952us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.932736:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784045438.166279:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045438.166403:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830464 00000100:00100000:2.0:1784045438.166413:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830464 00000100:00100000:2.0:1784045438.166484:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1784045438.166496:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:261a809c-20e2-4e50-abff-b9519e12c29d+6:13865:x1870706808830464:12345-192.168.201.58@tcp:101:mkdir.0 00010000:00010000:2.0:1784045438.166517:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045438.166541:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218001d0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045438.166607:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045438.166621:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045438.166646:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045438.166867:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784045438.166871:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045438.166972:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045438.166998:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 8 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045438.167015:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 7 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045438.167022:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045438.167025:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045438.167028:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045438.167095:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:261a809c-20e2-4e50-abff-b9519e12c29d+7:13865:x1870706808830464:12345-192.168.201.58@tcp:101:mkdir.0 Request processed in 601us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045438.167103:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:0.0:1784045438.498481:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045439.010938:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045439.533966:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045440.418535:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829791488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045440.418637:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.418737:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791488 00000100:00100000:0.0:1784045440.418747:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791488 00000100:00100000:0.0:1784045440.419223:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045440.419235:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829791488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045440.419282:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045440.422543:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829791488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3236us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045440.422561:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1784045440.426344:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045440.426772:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829791616:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427196:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829791744:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427239:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.427295:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045440.427301:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829791872:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427327:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.427361:0:16011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791744 00000100:00100000:0.0:1784045440.427369:0:16011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791744 00000100:00100000:0.0:1784045440.427438:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045440.427448:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829791744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427510:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829791744:12345-0@lo:400:kworker.0 Request processed in 63us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045440.427518:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045440.427543:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791872 00000100:00100000:0.0:1784045440.427547:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791872 00000100:00100000:0.0:1784045440.427575:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045440.427582:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829791872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427615:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1870706829791872:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045440.427622:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1784045440.427636:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045440.427674:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1870706829791872:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427689:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829791744:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427741:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829792000:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.427777:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.427806:0:3318:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1784045440.427826:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829791488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045440.427874:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829792000 00000100:00100000:0.0:1784045440.427877:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829792000 00000100:00100000:1.0:1784045440.429162:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.429914:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045440.429929:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829792000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.430013:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1870706829792000:12345-0@lo:400:kworker.0 Request processed in 89us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045440.430021:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1784045440.430045:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045440.430462:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1870706829792000:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.430548:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829792128:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.430589:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.430620:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829792128 00000100:00100000:0.0:1784045440.430627:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829792128 00000100:00100000:0.0:1784045440.430664:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045440.430671:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829792128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045440.430862:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829791616 00000100:00100000:2.0:1784045440.430867:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829791616 00000100:00100000:2.0:1784045440.430909:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784045440.430916:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3319:x1870706829791616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045440.430960:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3319:x1870706829791616:12345-0@lo:400:kworker.0 Request processed in 44us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045440.430966:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045440.432188:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1870706829792128:12345-0@lo:400:kworker.0 Request processed in 1513us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045440.432198:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1784045440.432224:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045440.432267:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3319:1870706829791616:0@lo:400:kworker.0 00000100:00100000:0.0:1784045440.432282:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1870706829792128:0@lo:400:kworker.0 00000001:00100000:0.0:1784045440.502315:0:7510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 261a809c-20e2-4e50-abff-b9519e12c29d 00000001:00100000:3.0:1784045440.529710:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 261a809c-20e2-4e50-abff-b9519e12c29d 00000001:00100000:3.0:1784045440.529733:0:5826:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e5d4df7-21bd-4c55-9ea9-223194ff0253 00010000:00010000:2.0:1784045440.545200:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045441.437203:0:16104:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1784045441.514864:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 261a809c-20e2-4e50-abff-b9519e12c29d 00010000:00010000:1.0:1784045441.569954:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045441.953781:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829792256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045441.953890:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045441.954242:0:14876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829792256 00000100:00100000:1.0:1784045441.954251:0:14876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829792256 00000100:00100000:1.0:1784045441.954304:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045441.954314:0:14876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829792256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045441.954351:0:14876:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045441.954974:0:14876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1870706829792256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 660us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045441.954983:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045441.960820:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1870706829792256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045442.608904:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045442.982166:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982229:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982272:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982291:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045442.982345:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830592 00000100:00100000:2.0:1784045442.982353:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830592 00000100:00100000:2.0:1784045442.982415:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1784045442.982426:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:2362:x1870706808830592:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.982495:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:2362:x1870706808830592:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 70us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.982503:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1784045442.982539:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831104 00000100:00100000:2.0:1784045442.982542:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831104 00000100:00100000:2.0:1784045442.982580:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830720 00000100:00100000:2.0:1784045442.982584:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830720 00000100:00100000:2.0:1784045442.982605:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1784045442.982612:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:261a809c-20e2-4e50-abff-b9519e12c29d+6:2362:x1870706808831104:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.982664:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:261a809c-20e2-4e50-abff-b9519e12c29d+6:2362:x1870706808831104:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 52us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.982671:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1784045442.982684:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1784045442.982691:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2362:x1870706808830720:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.982724:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2362:x1870706808830720:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.982731:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1784045442.982750:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830848 00000100:00100000:2.0:1784045442.982753:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830848 00000100:00100000:2.0:1784045442.982773:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831360 00000100:00100000:2.0:1784045442.982775:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831360 00000100:00100000:2.0:1784045442.982788:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808830976 00000100:00100000:2.0:1784045442.982790:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808830976 00000100:00100000:2.0:1784045442.982799:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831232 00000100:00100000:2.0:1784045442.982800:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831232 00000100:00100000:2.0:1784045442.982812:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:2.0:1784045442.982818:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2362:x1870706808830848:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.982877:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2362:x1870706808830848:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 59us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.982883:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:2.0:1784045442.982894:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784045442.982899:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:261a809c-20e2-4e50-abff-b9519e12c29d+5:2362:x1870706808831360:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.982923:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f73aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:261a809c-20e2-4e50-abff-b9519e12c29d+5:2362:x1870706808831360:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.982928:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784045442.982937:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045442.982942:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2362:x1870706808830976:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.982961:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2362:x1870706808830976:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 19us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.982977:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045442.982988:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1784045442.982994:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:261a809c-20e2-4e50-abff-b9519e12c29d+5:2362:x1870706808831232:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045442.983018:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:261a809c-20e2-4e50-abff-b9519e12c29d+5:2362:x1870706808831232:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045442.983024:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00080000:2.0:1784045442.983055:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045442.983060:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045442.983062:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784045443.617187:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045444.641242:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045444.874716:0:16253:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebabf6a50 20000000:00000080:0.0:1784045444.874748:0:16253:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8aa928f90800 uarg=0000000000000000 20000000:01000000:0.0:1784045444.874796:0:16253:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784045444.874803:0:16253:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784045444.874809:0:16253:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784045444.876180:0:16254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1784045444.876347:0:16253:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784045444.886719:0:16253:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784045444.887606:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887684:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887693:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 18 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887700:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887712:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887720:0:16253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887727:0:16253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887805:0:16253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.887856:0:16253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 12 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.887875:0:16253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937740380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792384:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045444.888697:0:16253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.888709:0:16253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.888722:0:16253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792512:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045444.899733:0:16253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 18 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.899759:0:16253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 18 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.899780:0:16253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792640:0@lo:104: 00000100:00100000:0.0:1784045444.899879:0:16253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045444.899926:0:16253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 18 pid: 14229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.899935:0:16253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 18 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.899963:0:16253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792768:0@lo:104: 00000100:00100000:0.0:1784045444.899985:0:16253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045444.900004:0:16253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045444.900012:0:16253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 18 pid: 14231 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.900020:0:16253:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792896:0@lo:104: 00000100:00100000:0.0:1784045444.900043:0:16253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.900054:0:16253:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9102afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045444.900086:0:16253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937740380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792384:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045444.900097:0:16253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792512:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784045444.900196:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784045444.900212:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829792640 00000100:00100000:3.0:1784045444.900219:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829792640 00000100:00100000:3.0:1784045444.900263:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829792768 00000100:00100000:3.0:1784045444.900266:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829792768 00000100:00100000:3.0:1784045444.900276:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829792896 00000100:00100000:3.0:1784045444.900279:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829792896 00000100:00100000:3.0:1784045444.900293:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045444.900302:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+5:16253:x1870706829792640:12345-0@lo:104: 00010000:00010000:3.0:1784045444.900318:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900396:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045444.900403:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+5:16253:x1870706829792640:12345-0@lo:104: Request processed in 102us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045444.900412:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045444.900431:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045444.900437:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+4:16253:x1870706829792768:12345-0@lo:104: 00010000:00010000:3.0:1784045444.900455:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900491:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784045444.900497:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+4:16253:x1870706829792768:12345-0@lo:104: Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045444.900504:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045444.900515:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045444.900701:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f668050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:16253:x1870706829792896:12345-0@lo:104: 00010000:00010000:3.0:1784045444.900710:0:14220:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900743:0:14220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784045444.900749:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f668050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+3:16253:x1870706829792896:12345-0@lo:104: Request processed in 228us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045444.900755:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1784045444.900808:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045444.900815:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900858:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030800 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045444.900863:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900873:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045444.900881:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045444.900894:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045444.900929:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900937:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045444.900958:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900967:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa900030800/0xdb5b5ff6a2d2df7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2df82 expref: -99 pid: 15539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900983:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045444.900986:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.900993:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361c00 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045444.900997:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901004:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045444.901011:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045444.901017:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045444.901028:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901035:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045444.901058:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901065:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa92d361c00/0xdb5b5ff6a2d2de47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de4e expref: -99 pid: 14871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901076:0:14224:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045444.901079:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901086:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa92d361600 already unused, calling callback (ffffffffc1cd9c20) 10000000:00010000:3.0:1784045444.901089:0:14224:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901096:0:14224:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045444.901102:0:14224:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045444.901107:0:14224:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045444.901119:0:14224:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901125:0:14224:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045444.901131:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901137:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8aa92d361600/0xdb5b5ff6a2d2ddfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdb5b5ff6a2d2de01 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.901162:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045444.901163:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045444.901165:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045444.901181:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829793152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045444.901220:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045444.901257:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045444.901263:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829793280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045444.901283:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045444.901313:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793152 00000100:00100000:3.0:1784045444.901318:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793152 00010000:00010000:3.0:1784045444.901340:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 19 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045444.901362:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793280 00010000:00010000:2.0:1784045444.901476:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045444.901498:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829793024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045444.901541:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045444.901602:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793024 00000100:00100000:2.0:1784045444.901606:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793024 00010000:00010000:2.0:1784045444.901739:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 20 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045444.901758:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045444.901765:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+20:3318:x1870706829793152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045444.901778:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045444.901784:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 20 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.901795:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 20 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.901863:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045444.901904:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+20:3318:x1870706829793152:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045444.901912:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045444.901927:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045444.901934:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937738c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3321:x1870706829793024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045444.901941:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045444.901946:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 19 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.901954:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 19 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.901964:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045444.901990:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937738c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3321:x1870706829793024:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045444.901996:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045444.902025:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829793024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045444.902050:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829793152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045444.902883:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa942173000/0xdb5b5ff6a2d2df82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2df7b expref: 18 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.902900:0:16253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792640:0@lo:104: 00010000:00010000:0.0:1784045444.902912:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2de4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2de47 expref: 17 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045444.902921:0:16253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792768:0@lo:104: 00000100:00100000:0.0:1784045444.902931:0:16253:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16253:1870706829792896:0@lo:104: 00010000:00010000:0.0:1784045444.902967:0:16253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045444.903221:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793280 00010000:00010000:3.0:1784045444.903253:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 17 pid: 14231 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045444.903280:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045444.903286:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:3318:x1870706829793280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045444.903297:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045444.903302:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 17 pid: 14231 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.903311:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 17 pid: 14231 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.903323:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937721a00/0xdb5b5ff6a2d2de01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdb5b5ff6a2d2ddfa expref: 17 pid: 14231 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045444.903346:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045444.904989:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3318:x1870706829793280:12345-0@lo:103:ldlm_bl.0 Request processed in 1690us (3693us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045444.905005:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045444.905208:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045444.906088:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831488 00000100:00100000:2.0:1784045444.906102:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831488 00010000:00010000:2.0:1784045444.906153:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 13 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045444.906196:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045444.906206:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9601e793-9924-4b38-b573-084004e89c20+13:2360:x1870706808831488:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045444.906224:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045444.906230:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 13 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.906256:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 13 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.906278:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa937720c00/0xdb5b5ff6a2d2e0e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001a6 expref: 13 pid: 14230 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.906299:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045444.906485:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045444.906587:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9601e793-9924-4b38-b573-084004e89c20+12:2360:x1870706808831488:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 161us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045444.906596:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045444.910808:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831616 00000100:00100000:2.0:1784045444.910856:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831616 00010000:00010000:2.0:1784045444.910929:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045444.910970:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1784045444.910980:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9601e793-9924-4b38-b573-084004e89c20+12:2360:x1870706808831616:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045444.910999:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045444.911006:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911021:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911045:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e0a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800144 expref: 12 pid: 14229 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911065:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911094:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911117:0:14221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911125:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911133:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911140:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911148:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045444.911153:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911162:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911179:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045444.911191:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045444.911263:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9601e793-9924-4b38-b573-084004e89c20+11:2360:x1870706808831616:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 283us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045444.911272:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00010000:00010000:1.0:1784045444.911419:0:16253:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045444.911430:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045444.911437:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8aa80311b800/0xdb5b5ff6a2d2e10a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045444.923991:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3318:1870706829793280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045445.537050:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829793536:0@lo:400:kworker.0 00000100:00100000:1.0:1784045445.537147:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.537208:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829794048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045445.537239:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.537268:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784045445.537273:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829793408:0@lo:400:kworker.0 00000100:00100000:1.0:1784045445.537321:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.537343:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829793920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045445.537365:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.537393:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829793792:0@lo:400:kworker.0 00000100:00100000:1.0:1784045445.537417:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.537436:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045445.537441:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa92d02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829793664:0@lo:400:kworker.0 00000100:00100000:1.0:1784045445.537464:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.537491:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793536 00000100:00100000:1.0:1784045445.537500:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793536 00000100:00100000:1.0:1784045445.537567:0:14873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793664 00000100:00100000:1.0:1784045445.537570:0:14873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793664 00000100:00100000:1.0:1784045445.537768:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045445.537784:0:14873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829793536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045445.537957:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793408 00000100:00100000:0.0:1784045445.537963:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793408 00000100:00100000:0.0:1784045445.538006:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784045445.538012:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3321:x1870706829793408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045445.538062:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:3321:x1870706829793408:12345-0@lo:400:kworker.0 Request processed in 50us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.538070:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784045445.538203:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829793408:0@lo:400:kworker.0 00000100:00100000:0.0:1784045445.538230:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045445.538240:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829794176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045445.538268:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045445.538298:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794176 00000100:00100000:0.0:1784045445.538301:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794176 00000100:00100000:0.0:1784045445.538328:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045445.538335:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829794176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045445.538369:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045445.538407:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1870706829794176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.538413:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045445.538450:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829794176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045445.538492:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045445.538500:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829793664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045445.538536:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829793664:12345-0@lo:400:kworker.0 Request processed in 36us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.538543:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045445.538577:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794048 00000100:00100000:0.0:1784045445.538582:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794048 00000100:00100000:2.0:1784045445.539742:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793920 00000100:00100000:2.0:1784045445.539752:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793920 00000100:00100000:1.0:1784045445.540343:0:14873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829793536:12345-0@lo:400:kworker.0 Request processed in 2558us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045445.540356:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1784045445.540390:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045445.540397:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045445.540400:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045445.541122:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829793664:0@lo:400:kworker.0 00000100:00100000:3.0:1784045445.541360:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829793792 00000100:00100000:1.0:1784045445.541706:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829793536:0@lo:400:kworker.0 00000100:00100000:3.0:1784045445.542163:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829793792 00000100:00100000:2.0:1784045445.542381:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045445.542395:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829794048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045445.542490:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829794048:12345-0@lo:400:kworker.0 Request processed in 101us (5251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045445.542497:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045445.542512:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784045445.542518:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829793920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045445.542543:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870706829793920:12345-0@lo:400:kworker.0 Request processed in 26us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045445.542549:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045445.543019:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1870706829793920:0@lo:400:kworker.0 00000100:00100000:0.0:1784045445.543036:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829794048:0@lo:400:kworker.0 00000100:00100000:3.0:1784045445.543432:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045445.543442:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829793792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045445.543502:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829793792:12345-0@lo:400:kworker.0 Request processed in 62us (6084us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045445.543509:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045445.543604:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa92d02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829793792:0@lo:400:kworker.0 00010000:00010000:0.0:1784045445.667281:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784045446.627706:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045446.627718:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa91077f000 from 10 10000000:01000000:0.0:1784045446.627724:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045446.627784:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.627812:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.627826:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045446.627873:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.627964:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045446.628096:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045446.633562:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794304 00000100:00100000:1.0:1784045446.633585:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794304 00000100:00100000:1.0:1784045446.633667:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784045446.633677:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+16:14233:x1870706829794304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045446.633701:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045446.633749:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2e118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2e111 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045446.633883:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2e118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2e111 expref: 17 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045446.633897:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa900030c00/0xdb5b5ff6a2d2e118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2e111 expref: 17 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045446.633909:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030c00, rc 0) 00000100:00100000:1.0:1784045446.634031:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14233:x1870706829794304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 355us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045446.634041:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784045446.634168:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045446.634193:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e118 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.634206:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2e118 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045446.634295:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.634333:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045446.634372:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045446.638055:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794432 00000100:00100000:0.0:1784045446.638076:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794432 00000100:00100000:0.0:1784045446.643259:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784045446.643285:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14233:x1870706829794432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.643696:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14233:x1870706829794432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (9361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.643706:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784045446.650334:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045446.650441:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045446.650565:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045446.650611:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab78d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045446.651428:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794560 00000100:00100000:0.0:1784045446.651451:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794560 00000100:00100000:0.0:1784045446.651520:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784045446.651531:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14233:x1870706829794560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.651824:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14233:x1870706829794560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.651851:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784045446.652550:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd14e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784045446.673428:0:16321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784045446.675401:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784045446.675448:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045446.675463:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e118 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045446.675479:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa80311be00/0xdb5b5ff6a2d2e111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e118 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045446.675570:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045446.675703:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa90fac8800 from 10 10000000:01000000:3.0:1784045446.675707:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045446.675759:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.675770:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.675784:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045446.675933:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.676029:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045446.676193:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa906bb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045446.676239:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794688 00000100:00100000:0.0:1784045446.676248:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794688 00000100:00100000:0.0:1784045446.676359:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784045446.676370:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9391ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+17:14233:x1870706829794688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045446.676389:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045446.676406:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa80311a000/0xdb5b5ff6a2d2e126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2e11f expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.676436:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311a000/0xdb5b5ff6a2d2e126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2e11f expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.676449:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa80311a000/0xdb5b5ff6a2d2e126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2e11f expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.676461:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311a000, rc 0) 00000100:00100000:0.0:1784045446.676517:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9391ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829794688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.676525:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784045446.676614:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045446.676642:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e126 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.676653:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2e126 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045446.676718:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.676747:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045446.677025:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa906bb5540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045446.677165:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794816 00000100:00100000:1.0:1784045446.677171:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794816 00000100:00100000:1.0:1784045446.677199:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784045446.677206:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829794816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045446.677529:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829794816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045446.677537:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784045446.677800:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.677862:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.677912:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045446.677938:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa906bb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045446.678000:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829794944 00000100:00100000:0.0:1784045446.678007:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829794944 00000100:00100000:0.0:1784045446.678034:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045446.678041:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829794944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.678283:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829794944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.678291:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784045446.678405:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829794944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784045446.679485:0:16322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784045446.679983:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784045446.680017:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045446.680033:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e126 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.680047:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942172800/0xdb5b5ff6a2d2e11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e126 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045446.680060:0:14233:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045446.680064:0:14233:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8aa939d58800 from 10 10000000:01000000:3.0:1784045446.680067:0:14233:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045446.680205:0:14233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.680214:0:14233:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.680225:0:14233:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045446.680252:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829795072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.680324:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045446.680372:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa914fe1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045446.680420:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829795072 00000100:00100000:0.0:1784045446.680428:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829795072 00000100:00100000:0.0:1784045446.680482:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045446.680492:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+18:14233:x1870706829795072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045446.680505:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045446.680521:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa80311ba00/0xdb5b5ff6a2d2e134 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdb5b5ff6a2d2e12d expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.680550:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311ba00/0xdb5b5ff6a2d2e134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2e12d expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.680561:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa80311ba00/0xdb5b5ff6a2d2e134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdb5b5ff6a2d2e12d expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.680570:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311ba00, rc 0) 00000100:00100000:0.0:1784045446.680896:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829795072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.680904:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784045446.681028:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829795072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045446.681043:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e134 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045446.681054:0:14233:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdb5b5ff6a2d2e134 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045446.681190:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829795200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.681221:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045446.681252:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa914fe1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045446.681303:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829795200 00000100:00100000:2.0:1784045446.681310:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829795200 00000100:00100000:2.0:1784045446.681348:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784045446.681356:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829795200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045446.681678:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829795200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045446.681694:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045446.681871:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa9082a2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829795200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.681910:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829795328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.681956:0:14233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045446.681976:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90829bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045446.682036:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829795328 00000100:00100000:3.0:1784045446.682041:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829795328 00000100:00100000:3.0:1784045446.682079:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784045446.682147:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829795328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.682319:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:14233:x1870706829795328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045446.682326:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784045446.682365:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ecfa0ba9-cdb8-42f8-923d-132e8368012c:14233:1870706829795328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784045446.683347:0:16323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784045446.683708:0:14233:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784045446.683732:0:14233:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045446.683746:0:14233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e134 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045446.683759:0:14233:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8aa942172e00/0xdb5b5ff6a2d2e12d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdb5b5ff6a2d2e134 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045446.689068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1784045446.689875:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045446.690984:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831744 00000100:00100000:2.0:1784045446.690996:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831744 00000100:00100000:2.0:1784045446.691067:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:2.0:1784045446.691076:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+11:13718:x1870706808831744:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045446.691093:0:14230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045446.691112:0:14230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2e13b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055218001d7 expref: -99 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045446.691141:0:14230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2e13b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001d7 expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045446.691155:0:14230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa937721800/0xdb5b5ff6a2d2e13b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001d7 expref: 12 pid: 14230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045446.691164:0:14230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721800, rc 0) 00000100:00100000:2.0:1784045446.691228:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+12:13718:x1870706808831744:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 150us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045446.691236:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:1.0:1784045446.705292:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045446.705501:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808831872 00000100:00100000:2.0:1784045446.705530:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808831872 00000100:00100000:2.0:1784045446.705604:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:2.0:1784045446.705621:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+12:13718:x1870706808831872:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045446.705987:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+12:13718:x1870706808831872:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 371us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045446.705997:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:0.0:1784045446.709477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045446.709623:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832000 00000100:00100000:2.0:1784045446.709637:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832000 00000100:00100000:2.0:1784045446.709702:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:2.0:1784045446.709713:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+12:13718:x1870706808832000:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045446.710004:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+12:13718:x1870706808832000:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 292us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045446.710013:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:3.0:1784045446.729158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045446.729268:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832128 00000100:00100000:0.0:1784045446.729303:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832128 00000100:00100000:0.0:1784045446.729385:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:0.0:1784045446.729398:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+12:13718:x1870706808832128:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045446.729422:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045446.729447:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8aa80311a200/0xdb5b5ff6a2d2e142 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9edda055218001de expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.729488:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8aa80311a200/0xdb5b5ff6a2d2e142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001de expref: 13 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.729502:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8aa80311a200/0xdb5b5ff6a2d2e142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001de expref: 13 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045446.729513:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311a200, rc 0) 00000100:00100000:0.0:1784045446.729601:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:13718:x1870706808832128:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 206us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.729609:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:1.0:1784045446.733023:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045446.733107:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832256 00000100:00100000:0.0:1784045446.733118:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832256 00000100:00100000:0.0:1784045446.733181:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1784045446.733191:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+13:13718:x1870706808832256:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045446.733738:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9601e793-9924-4b38-b573-084004e89c20+13:13718:x1870706808832256:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 545us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045446.733746:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:1.0:1784045446.740056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045446.740175:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832384 00000100:00100000:3.0:1784045446.740187:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832384 00000100:00100000:3.0:1784045446.740253:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1784045446.740263:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+13:13718:x1870706808832384:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045446.740491:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9601e793-9924-4b38-b573-084004e89c20+13:13718:x1870706808832384:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 228us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045446.740499:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:2.0:1784045447.074036:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829795456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045447.074110:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045447.074226:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829795456 00000100:00100000:1.0:1784045447.074234:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829795456 00000100:00100000:1.0:1784045447.074305:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784045447.074313:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829795456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045447.074349:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045447.074394:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1870706829795456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00080000:2.0:1784045447.074546:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045447.074595:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1870706829795456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045447.074695:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1784045447.713124:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045448.095436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045448.095484:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045448.095528:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832512 00000100:00100000:3.0:1784045448.095536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045448.095538:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832512 00000100:00100000:3.0:1784045448.095573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045448.095594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045448.095594:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:1.0:1784045448.095603:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:2363:x1870706808832512:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045448.095609:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045448.095629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045448.095669:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:2363:x1870706808832512:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045448.095671:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832768 00000100:00100000:3.0:1784045448.095675:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832768 00000100:00100000:1.0:1784045448.095677:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:3.0:1784045448.095701:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833280 00000100:00100000:3.0:1784045448.095704:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833280 00000100:00100000:1.0:1784045448.095706:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832896 00000100:00100000:1.0:1784045448.095708:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832896 00000100:00100000:3.0:1784045448.095716:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833152 00000100:00100000:3.0:1784045448.095718:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833152 00000100:00100000:1.0:1784045448.095723:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045448.095729:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2363:x1870706808832768:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045448.095731:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784045448.095737:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:261a809c-20e2-4e50-abff-b9519e12c29d+5:2363:x1870706808833280:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784045448.095757:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:261a809c-20e2-4e50-abff-b9519e12c29d+5:2363:x1870706808833280:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045448.095758:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2363:x1870706808832768:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045448.095778:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784045448.095861:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833024 00000100:00100000:2.0:1784045448.095865:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833024 00000100:00100000:2.0:1784045448.095895:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808832640 00000100:00100000:2.0:1784045448.095898:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808832640 00000100:00100000:2.0:1784045448.095918:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:2.0:1784045448.095925:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:2363:x1870706808833024:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045448.095956:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:2363:x1870706808833024:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 31us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045448.095973:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:2.0:1784045448.095987:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1784045448.095992:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2363:x1870706808832640:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784045448.096015:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2363:x1870706808832640:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045448.096020:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00080000:2.0:1784045448.096040:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045448.096045:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045448.096047:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045448.105595:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045448.105645:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784045448.105664:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2363:x1870706808832896:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045448.105744:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2363:x1870706808832896:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 90us (10132us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045448.105777:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784045448.105795:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784045448.105803:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:2363:x1870706808833152:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045448.105848:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:2363:x1870706808833152:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 46us (10217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045448.105855:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:3.0:1784045448.737444:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045449.024136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.025003:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833408 00000100:00100000:2.0:1784045449.025015:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833408 00000100:00100000:2.0:1784045449.025082:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1784045449.025092:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:14376:x1870706808833408:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045449.025111:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045449.025132:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218001e5 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025190:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025212:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025224:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025239:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025260:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025267:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025826:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2e15e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025874:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2e15e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.025882:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2e15e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045449.025971:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784045449.025976:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045449.026070:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2e15e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026082:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026088:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026095:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026101:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045449.026105:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026117:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026129:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045449.026132:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045449.026136:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026143:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026154:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026160:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026166:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026170:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045449.026173:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026179:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026185:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045449.026187:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045449.026190:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026210:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026244:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001e5 expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026260:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720a00/0xdb5b5ff6a2d2e15e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001e5 expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.026267:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa902ec0b00) 00010000:00010000:2.0:1784045449.026270:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045449.026272:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720a00, rc 0) 00000100:00100000:2.0:1784045449.027061:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:14376:x1870706808833408:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1965us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045449.027071:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1784045449.038495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.038970:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833664 00000100:00100000:0.0:1784045449.038980:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833664 00000100:00100000:0.0:1784045449.039048:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784045449.039072:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:14376:x1870706808833664:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045449.039095:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.039119:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e165 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218001ec expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.039196:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.039210:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.039223:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.039237:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.039244:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.039252:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040030:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b400/0xdb5b5ff6a2d2e17a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040043:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b400/0xdb5b5ff6a2d2e17a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040050:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b400/0xdb5b5ff6a2d2e17a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.040072:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1784045449.040330:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040338:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040344:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040350:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311ac00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.040354:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040362:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040374:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8aa902ec0b00) 00010000:00010000:0.0:1784045449.040377:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.040382:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040388:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e16c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040400:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040405:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040421:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040427:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.040430:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040437:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040446:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8aa9118c5800) 00010000:00010000:0.0:1784045449.040449:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.040452:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.040458:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e173 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.043866:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e165 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001ec expref: 10 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.043897:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b400/0xdb5b5ff6a2d2e17a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001ec expref: 9 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.043907:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa9118c5a00) 00010000:00010000:0.0:1784045449.043910:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.043913:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311b400, rc 0) 00000100:00100000:0.0:1784045449.043991:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14376:x1870706808833664:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 4920us (5507us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784045449.044011:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784045449.056053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.056128:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833792 00000100:00100000:0.0:1784045449.056138:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833792 00000100:00100000:0.0:1784045449.056200:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045449.056217:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14376:x1870706808833792:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1784045449.056326:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14376:x1870706808833792:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045449.056334:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:1.0:1784045449.108939:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.109043:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808833920 00000100:00100000:2.0:1784045449.109053:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808833920 00000100:00100000:2.0:1784045449.109116:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1784045449.109126:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14382:x1870706808833920:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784045449.109146:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045449.109167:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218001f3 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109227:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109242:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109268:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109284:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109305:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109311:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109564:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109572:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109578:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109584:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045449.109588:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109595:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109619:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045449.109623:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045449.109628:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109642:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e18f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109656:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109662:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109668:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109674:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045449.109677:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109683:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109691:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045449.109694:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045449.109696:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.109702:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e196 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.110127:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e188 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001f3 expref: 10 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.110151:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045449.110153:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045449.110158:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001f3 expref: 10 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.110168:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937721600, rc 0) 00000100:00100000:2.0:1784045449.110228:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14382:x1870706808833920:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1103us (1298us total) trans 0 rc 301/301 00000100:00100000:2.0:1784045449.110236:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784045449.116892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045449.116987:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808834048 00000100:00100000:3.0:1784045449.116998:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808834048 00000100:00100000:3.0:1784045449.117059:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784045449.117069:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14382:x1870706808834048:12345-192.168.201.58@tcp:700:lfs.0 00000100:00100000:3.0:1784045449.117161:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14382:x1870706808834048:12345-192.168.201.58@tcp:700:lfs.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045449.117169:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784045449.119095:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.119539:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808834304 00000100:00100000:2.0:1784045449.119547:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808834304 00000100:00100000:2.0:1784045449.119613:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1784045449.119623:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14382:x1870706808834304:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:2.0:1784045449.119675:0:14237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045449.119702:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e0cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180016e expref: 9 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.119720:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045449.119724:0:14237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045449.119996:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.120010:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 5 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.120019:0:14237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.120054:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 5 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.120067:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 5 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045449.120082:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1870706829795584:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045449.120163:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045449.124057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.124111:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14237:1870706829795584:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045449.124131:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808834432 00000100:00100000:2.0:1784045449.124139:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808834432 00010000:00010000:0.0:1784045449.124140:0:14237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124172:0:14221:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 6 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045449.124225:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1784045449.124235:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:261a809c-20e2-4e50-abff-b9519e12c29d+6:2361:x1870706808834432:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045449.124249:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045449.124260:0:14221:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 6 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124272:0:14221:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 6 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124482:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda055218001d0 expref: 6 pid: 14237 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124500:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:2.0:1784045449.124518:0:14221:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124527:0:14221:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124534:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.124570:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045449.124623:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:261a809c-20e2-4e50-abff-b9519e12c29d+5:2361:x1870706808834432:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 389us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045449.124630:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00010000:00010000:0.0:1784045449.124683:0:14237:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.124690:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.124716:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.124725:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.124734:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.126185:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784045449.126206:0:14237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.126215:0:14237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.126223:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.126229:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.126233:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.126240:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.126255:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa92210c900) 00010000:00010000:0.0:1784045449.126258:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.126262:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.126269:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e19d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045449.126287:0:14237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066e509ed reply state 00000000980f92e5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045449.126295:0:14237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045449.126370:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+10:14382:x1870706808834304:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 6747us (7280us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1784045449.126380:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00010000:00010000:3.0:1784045449.129784:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.129802:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.129823:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.129858:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045449.129863:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.129871:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.129888:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa9118c5800) 00010000:00010000:3.0:1784045449.129891:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045449.129896:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.129903:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e1a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045449.243735:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.243876:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808834560 00000100:00100000:0.0:1784045449.243898:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808834560 00000100:00100000:0.0:1784045449.243962:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1784045449.243972:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:14390:x1870706808834560:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:0.0:1784045449.243994:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.244018:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda055218001fa expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.244080:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e1b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.244095:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.244106:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.244434:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784045449.244439:0:14236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045449.244489:0:14236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e1b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.244515:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001fa expref: 11 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.244533:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ac00/0xdb5b5ff6a2d2e1b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda055218001fa expref: 10 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.244615:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:0.0:1784045449.244618:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045449.244621:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311ac00, rc 0) 00000100:00100000:0.0:1784045449.244684:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+10:14390:x1870706808834560:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 712us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045449.244690:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000040:00080000:3.0:1784045449.249764:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784045449.294358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.297195:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808834688 00000100:00100000:0.0:1784045449.297935:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808834688 00000100:00100000:1.0:1784045449.298637:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1784045449.298650:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:14391:x1870706808834688:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045449.298671:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045449.298694:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800201 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.298769:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030000/0xdb5b5ff6a2d2e1c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.298783:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030000/0xdb5b5ff6a2d2e1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.298811:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030000/0xdb5b5ff6a2d2e1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045449.298903:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784045449.298908:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045449.298935:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030000/0xdb5b5ff6a2d2e1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.298960:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800201 expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.298979:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030000/0xdb5b5ff6a2d2e1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800201 expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.298988:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045449.298992:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045449.298995:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030000, rc 0) 00000100:00100000:1.0:1784045449.299479:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:14391:x1870706808834688:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 828us (5128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045449.299488:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784045449.303503:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045449.303928:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808834816 00000100:00100000:1.0:1784045449.303938:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808834816 00000100:00100000:1.0:1784045449.304079:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784045449.304090:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:14391:x1870706808834816:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045449.304111:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045449.304133:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e1c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800208 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.304905:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.304921:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.304933:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.304948:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.304955:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.304962:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305101:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e1dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305109:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e1dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305117:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e1dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045449.305396:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784045449.305401:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784045449.305433:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e1dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305459:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305466:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305474:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305480:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045449.305484:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305492:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305505:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045449.305508:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045449.305513:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305518:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305531:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305606:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305613:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305626:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031c00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045449.305629:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305636:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305645:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa902edb700) 00010000:00010000:1.0:1784045449.305648:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045449.305651:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305657:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031c00/0xdb5b5ff6a2d2e1d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305692:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e1c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800208 expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305706:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e1dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800208 expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.305713:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa902edb900) 00010000:00010000:1.0:1784045449.305715:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045449.305718:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030400, rc 0) 00000100:00100000:1.0:1784045449.305899:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+7:14391:x1870706808834816:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1809us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045449.305908:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1784045449.313990:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.314086:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808835072 00000100:00100000:0.0:1784045449.314096:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808835072 00000100:00100000:1.0:1784045449.314259:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1784045449.314284:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+7:14391:x1870706808835072:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045449.314312:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045449.314334:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e1e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180020f expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045449.314448:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784045449.314578:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e1e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180020f expref: 9 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.314592:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045449.314594:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045449.314599:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e1e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180020f expref: 9 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.314614:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030800, rc 0) 00000100:00100000:1.0:1784045449.314679:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+8:14391:x1870706808835072:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 398us (698us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1784045449.314687:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:3.0:1784045449.319284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.319537:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808835328 00000100:00100000:0.0:1784045449.319558:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808835328 00000100:00100000:0.0:1784045449.319620:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:0.0:1784045449.319630:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:261a809c-20e2-4e50-abff-b9519e12c29d+8:14391:x1870706808835328:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:0.0:1784045449.319683:0:15092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045449.319713:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e1dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800208 expref: 8 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.319730:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa902edb900) 00010000:00010000:0.0:1784045449.319741:0:15092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045449.319776:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.319789:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.319799:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045449.320050:0:15092:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005511e287 reply state 000000006b0d9101 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045449.320061:0:15092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784045449.320090:0:15092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1784045449.320464:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:261a809c-20e2-4e50-abff-b9519e12c29d+9:14391:x1870706808835328:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 832us (1186us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784045449.320473:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00010000:00010000:0.0:1784045449.324675:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.324694:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.324703:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.324709:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.324713:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.324720:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.324736:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa9118c5500) 00010000:00010000:0.0:1784045449.324739:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1784045449.324755:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.324762:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e1f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045449.326509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.326755:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808835584 00000100:00100000:0.0:1784045449.326764:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808835584 00000100:00100000:0.0:1784045449.326823:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784045449.326851:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:261a809c-20e2-4e50-abff-b9519e12c29d+8:14391:x1870706808835584:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784045449.327113:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:261a809c-20e2-4e50-abff-b9519e12c29d+9:14391:x1870706808835584:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 264us (613us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784045449.327122:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784045449.331515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045449.331717:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808835840 00000100:00100000:1.0:1784045449.331727:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808835840 00000100:00100000:1.0:1784045449.331800:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:1.0:1784045449.331811:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+9:14391:x1870706808835840:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784045449.331872:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045449.331894:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800216 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.331971:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.331998:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332010:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332025:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332031:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332038:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045449.332349:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784045449.332444:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332451:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332457:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332463:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045449.332467:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332474:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332497:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045449.332500:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045449.332505:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332512:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031400/0xdb5b5ff6a2d2e1ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332526:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332532:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332609:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332615:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045449.332618:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332623:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332632:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa902edb700) 00010000:00010000:1.0:1784045449.332634:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045449.332637:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332643:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e206 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332697:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800216 expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332707:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:1.0:1784045449.332710:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045449.332713:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030a00/0xdb5b5ff6a2d2e1f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800216 expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045449.332723:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030a00, rc 0) 00000100:00100000:1.0:1784045449.332946:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+10:14391:x1870706808835840:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1137us (1439us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1784045449.332955:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:1.0:1784045449.337131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.337659:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808835968 00000100:00100000:0.0:1784045449.337668:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808835968 00000100:00100000:0.0:1784045449.337778:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:0.0:1784045449.337789:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:261a809c-20e2-4e50-abff-b9519e12c29d+10:14391:x1870706808835968:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045449.337813:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.337860:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e214 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180021d expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.337947:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.337963:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.337976:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.338032:0:15092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784045449.338036:0:15092:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045449.338058:0:15092:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.338081:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e214 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 12 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.338098:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 11 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.338120:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa9118c5500) 00010000:00010000:0.0:1784045449.338123:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045449.338126:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311b600, rc 0) 00000100:00100000:0.0:1784045449.338384:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:261a809c-20e2-4e50-abff-b9519e12c29d+11:14391:x1870706808835968:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 596us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045449.338391:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1784045449.341933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045449.342282:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808836096 00000100:00100000:1.0:1784045449.342302:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808836096 00000100:00100000:1.0:1784045449.342360:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1784045449.342371:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:261a809c-20e2-4e50-abff-b9519e12c29d+11:14391:x1870706808836096:12345-192.168.201.58@tcp:37:lfs.0 00000100:00100000:1.0:1784045449.347723:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:261a809c-20e2-4e50-abff-b9519e12c29d+11:14391:x1870706808836096:12345-192.168.201.58@tcp:37:lfs.0 Request processed in 5343us (5788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045449.347738:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1784045449.353044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.353131:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808836352 00000100:00100000:2.0:1784045449.353141:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808836352 00000100:00100000:2.0:1784045449.353276:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1784045449.353286:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d13050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:261a809c-20e2-4e50-abff-b9519e12c29d+11:14391:x1870706808836352:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045449.353556:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d13050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:261a809c-20e2-4e50-abff-b9519e12c29d+12:14391:x1870706808836352:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 263us (513us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784045449.353565:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1784045449.415458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.415784:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808836480 00000100:00100000:0.0:1784045449.415794:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808836480 00000100:00100000:0.0:1784045449.415891:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:0.0:1784045449.415902:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+10:14397:x1870706808836480:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045449.415921:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.415940:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800224 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416001:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416016:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416026:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416041:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416048:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416072:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416331:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e237 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416341:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e237 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416348:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e237 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.416380:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784045449.416383:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045449.416423:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e237 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416435:0:14237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416441:0:14237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416447:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416452:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.416457:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416464:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416484:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:0.0:1784045449.416487:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.416491:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416498:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e229 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416512:0:14237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416518:0:14237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416524:0:14237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416529:0:14237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.416532:0:14237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416550:0:14237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416558:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8aa9118c5000) 00010000:00010000:0.0:1784045449.416560:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.416562:0:14237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416568:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e230 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416610:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800224 expref: 12 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416623:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b800/0xdb5b5ff6a2d2e237 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800224 expref: 11 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.416630:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa9118c5500) 00010000:00010000:0.0:1784045449.416632:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784045449.416634:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311b800, rc 0) 00000100:00100000:0.0:1784045449.416821:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+11:14397:x1870706808836480:12345-192.168.201.58@tcp:101:bash.0 Request processed in 919us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045449.416863:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1784045449.420604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.420732:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808836736 00000100:00100000:2.0:1784045449.420753:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808836736 00000100:00100000:2.0:1784045449.420817:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:2.0:1784045449.420827:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+11:14397:x1870706808836736:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784045449.420871:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045449.420896:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e23e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180022b expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.421042:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.421058:0:14236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 11 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.421067:0:14236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.421101:0:14236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 11 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.421114:0:14236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 11 pid: 15092 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045449.421127:0:14236:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14236:1870706829795712:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045449.421489:0:14236:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045449.424108:0:14236:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14236:1870706829795712:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045449.424140:0:14236:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045449.425311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.425425:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808836864 00000100:00100000:2.0:1784045449.425433:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808836864 00010000:00010000:2.0:1784045449.425470:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 12 pid: 15092 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045449.425513:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1784045449.425542:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:261a809c-20e2-4e50-abff-b9519e12c29d+12:2361:x1870706808836864:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045449.425557:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045449.425563:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 12 pid: 15092 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.425576:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 12 pid: 15092 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.425597:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b600/0xdb5b5ff6a2d2e21b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180021d expref: 12 pid: 15092 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.425613:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa9118c5500) 00010000:00010000:2.0:1784045449.425617:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.425627:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.425635:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.425669:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045449.425724:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:261a809c-20e2-4e50-abff-b9519e12c29d+11:2361:x1870706808836864:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 189us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045449.425731:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00010000:00010000:3.0:1784045449.426642:0:14236:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.426661:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.426686:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.426696:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.426705:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427433:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427444:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427451:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045449.427462:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784045449.427496:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427503:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427510:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427515:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045449.427525:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427532:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427543:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa9118c5500) 00010000:00010000:3.0:1784045449.427546:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045449.427549:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427555:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721600/0xdb5b5ff6a2d2e245 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045449.427568:0:14236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002124566 reply state 00000000963daa92 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045449.427577:0:14236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784045449.427614:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e23e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 14 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427629:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 13 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045449.427636:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:3.0:1784045449.427639:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1784045449.427641:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa942173600, rc 0) 00000100:00100000:3.0:1784045449.427761:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:14397:x1870706808836736:12345-192.168.201.58@tcp:101:bash.0 Request processed in 6936us (7166us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1784045449.427769:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00010000:00010000:0.0:1784045449.433512:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.433531:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.433539:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.433545:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.433550:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.433558:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.433574:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8aa92210cb00) 00010000:00010000:0.0:1784045449.433593:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045449.433599:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.433605:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e24c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045449.441296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.441399:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808836992 00000100:00100000:0.0:1784045449.441407:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808836992 00000100:00100000:0.0:1784045449.441466:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784045449.441475:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+13:14397:x1870706808836992:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784045449.441497:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.441516:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e261 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800232 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441586:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441600:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441611:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.441649:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784045449.441653:0:14237:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784045449.441672:0:14237:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441684:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441725:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e261 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 15 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441754:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 14 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.441762:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045449.441765:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045449.441768:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311a600, rc 0) 00000100:00100000:0.0:1784045449.441877:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:14397:x1870706808836992:12345-192.168.201.58@tcp:101:bash.0 Request processed in 356us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045449.441884:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:3.0:1784045449.447736:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.447896:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808837248 00000100:00100000:2.0:1784045449.447906:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808837248 00000100:00100000:2.0:1784045449.447972:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:2.0:1784045449.447982:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:14397:x1870706808837248:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:2.0:1784045449.448356:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+15:14397:x1870706808837248:12345-192.168.201.58@tcp:35:bash.0 Request processed in 374us (628us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784045449.448364:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1784045449.552806:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.552992:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808837504 00000100:00100000:0.0:1784045449.553001:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808837504 00000100:00100000:0.0:1784045449.553061:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784045449.553072:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+15:14407:x1870706808837504:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045449.553097:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.553118:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e26f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800239 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.553257:0:15092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784045449.553386:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e26f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800239 expref: 17 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.553400:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8aa9118c5300) 00010000:00010000:0.0:1784045449.553403:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045449.553421:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e26f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800239 expref: 17 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.553436:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311b000, rc 0) 00000100:00100000:0.0:1784045449.553496:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+16:14407:x1870706808837504:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 425us (699us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1784045449.553504:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:3.0:1784045449.559276:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.559409:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808837760 00000100:00100000:2.0:1784045449.559419:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808837760 00000100:00100000:2.0:1784045449.559474:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784045449.559484:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+16:14407:x1870706808837760:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045449.559762:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+17:14407:x1870706808837760:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 279us (500us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784045449.559770:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784045449.618159:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.618252:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808838016 00000100:00100000:0.0:1784045449.618262:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808838016 00000100:00100000:0.0:1784045449.618334:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:0.0:1784045449.618344:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+17:14410:x1870706808838016:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784045449.618379:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045449.618401:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e27d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800240 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.618502:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e284 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.618516:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e284 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.618529:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e284 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045449.618554:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784045449.618683:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e27d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800240 expref: 20 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.618702:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e284 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800240 expref: 19 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.618724:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045449.618727:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045449.618731:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311a400, rc 0) 00000100:00100000:0.0:1784045449.618973:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14410:x1870706808838016:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 630us (821us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1784045449.618981:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1784045449.637269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045449.637480:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808838144 00000100:00100000:0.0:1784045449.637490:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808838144 00000100:00100000:0.0:1784045449.637559:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:0.0:1784045449.637570:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14410:x1870706808838144:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1784045449.637640:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637658:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637670:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637700:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637707:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637714:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637721:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045449.637751:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637759:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637772:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045449.637775:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045449.637780:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045449.637787:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e292 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045449.637912:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14410:x1870706808838144:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 344us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045449.637920:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784045449.640335:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.640519:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808838272 00000100:00100000:2.0:1784045449.640528:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808838272 00000100:00100000:2.0:1784045449.640631:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1784045449.640642:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa9082a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:2360:x1870706808838272:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045449.640658:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045449.640682:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a400/0xdb5b5ff6a2d2e284 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800240 expref: 19 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045449.640700:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:2.0:1784045449.640704:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045449.640773:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa9082a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+18:2360:x1870706808838272:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 133us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045449.640780:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784045449.651899:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045449.652025:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808838528 00000100:00100000:2.0:1784045449.652036:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808838528 00000100:00100000:2.0:1784045449.652085:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784045449.652110:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+18:14410:x1870706808838528:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784045449.652348:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14410:x1870706808838528:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 240us (458us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784045449.652365:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00010000:00010000:0.0:1784045449.761162:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045450.017229:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.017753:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808838784 00000100:00100000:0.0:1784045450.017762:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808838784 00000100:00100000:0.0:1784045450.017867:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1784045450.017879:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14441:x1870706808838784:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784045450.017903:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045450.017924:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e299 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800247 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.018024:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.018039:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.018063:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045450.018075:0:14237:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00080000:2.0:1784045450.018113:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784045450.018223:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e299 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800247 expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.018242:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800247 expref: 21 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.018251:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.018254:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045450.018257:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311ae00, rc 0) 00000100:00100000:0.0:1784045450.018525:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:14441:x1870706808838784:12345-192.168.201.58@tcp:101:cat.0 Request processed in 649us (1304us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1784045450.018532:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:3.0:1784045450.024465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.024517:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808839040 00000100:00100000:2.0:1784045450.024527:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808839040 00000100:00100000:2.0:1784045450.024595:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1784045450.024607:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:14441:x1870706808839040:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:2.0:1784045450.024957:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+22:14441:x1870706808839040:12345-192.168.201.58@tcp:35:cat.0 Request processed in 351us (513us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784045450.024965:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784045450.032676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.032811:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808839168 00000100:00100000:0.0:1784045450.032822:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808839168 00000100:00100000:0.0:1784045450.032925:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784045450.032936:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+22:2361:x1870706808839168:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045450.032949:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045450.032971:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800247 expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.032989:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.032994:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045450.033055:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:2361:x1870706808839168:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.033062:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:3.0:1784045450.117925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.118893:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808839424 00000100:00100000:0.0:1784045450.118904:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808839424 00000100:00100000:0.0:1784045450.119022:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:0.0:1784045450.119128:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:14447:x1870706808839424:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1784045450.119155:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045450.119179:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180024e expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119309:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119323:0:15092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 22 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119331:0:15092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119338:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119384:0:15092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 22 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119397:0:15092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 22 pid: 14237 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.119432:0:15092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15092:1870706829795840:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045450.119541:0:15092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 22 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.119550:0:15092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 22 pid: 14236 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.119559:0:15092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa937d35880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15092:1870706829795968:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045450.119581:0:15092:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9088be0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045450.124900:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.124900:0:15092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15092:1870706829795840:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784045450.124913:0:15092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa937d35880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15092:1870706829795968:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784045450.124937:0:15092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.124962:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.124986:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808839552 00000100:00100000:0.0:1784045450.124992:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808839552 00010000:00010000:0.0:1784045450.125025:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 23 pid: 14237 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.125068:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808839680 00000100:00100000:0.0:1784045450.125072:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808839680 00010000:00010000:0.0:1784045450.125084:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 24 pid: 14236 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.125098:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1784045450.125113:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937739450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:2360:x1870706808839552:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045450.125126:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045450.125132:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 24 pid: 14237 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125143:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 24 pid: 14237 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125165:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e268 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800232 expref: 24 pid: 14237 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125180:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.125185:0:14223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125193:0:14223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125210:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045450.125267:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937739450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+23:2360:x1870706808839552:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 153us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.125275:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1784045450.125322:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784045450.125328:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+22:2360:x1870706808839680:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045450.125335:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045450.125341:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 22 pid: 14236 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125361:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 22 pid: 14236 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125374:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173600/0xdb5b5ff6a2d2e253 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x9edda0552180022b expref: 22 pid: 14236 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125385:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.125389:0:14223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125396:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125403:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125423:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045450.125444:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:2360:x1870706808839680:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 116us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.125451:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00010000:00010000:0.0:1784045450.125474:0:15092:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125481:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045450.125500:0:15092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784045450.125655:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180024e expref: 22 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125682:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b000/0xdb5b5ff6a2d2e2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180024e expref: 21 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.125691:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.125693:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784045450.125696:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311b000, rc 0) 00000100:00100000:0.0:1784045450.125721:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:14447:x1870706808839424:12345-192.168.201.58@tcp:101:dd.0 Request processed in 6598us (7805us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1784045450.125738:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784045450.134036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.134141:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808839936 00000100:00100000:0.0:1784045450.134151:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808839936 00000100:00100000:0.0:1784045450.134212:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784045450.134222:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+21:14447:x1870706808839936:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1784045450.134513:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.134530:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.134542:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045450.134598:0:14237:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784045450.134627:0:14237:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7b84b4f reply state 0000000038de2276 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.134636:0:14237:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045450.134769:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14447:x1870706808839936:12345-192.168.201.58@tcp:36:dd.0 Request processed in 548us (741us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784045450.134776:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000020:00080000:0.0:1784045450.134781:0:14237:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784045450.139159:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.139176:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.139184:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.139190:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045450.139196:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.139203:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.139222:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.139225:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045450.139229:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.139235:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045450.139884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.140119:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840064 00000100:00100000:0.0:1784045450.140128:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840064 00000100:00100000:0.0:1784045450.140188:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:0.0:1784045450.140198:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+23:14447:x1870706808840064:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1784045450.140233:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045450.140252:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800255 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.140312:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800255 expref: 24 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.140327:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800255 expref: 24 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.140358:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.140361:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045450.140364:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311ae00, rc 0) 00000100:00100000:0.0:1784045450.140423:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14447:x1870706808840064:12345-192.168.201.58@tcp:101:dd.0 Request processed in 226us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.140430:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:1.0:1784045450.156346:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.156467:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840320 00000100:00100000:0.0:1784045450.156476:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840320 00000100:00100000:0.0:1784045450.156530:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784045450.156540:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14447:x1870706808840320:12345-192.168.201.58@tcp:103:dd.0 00010000:00010000:0.0:1784045450.156557:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045450.156593:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800255 expref: 24 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.156614:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.156619:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045450.156668:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+23:14447:x1870706808840320:12345-192.168.201.58@tcp:103:dd.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.156685:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784045450.159114:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.164606:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840448 00000100:00100000:0.0:1784045450.164621:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840448 00000100:00100000:0.0:1784045450.164687:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:0.0:1784045450.164697:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+23:14447:x1870706808840448:12345-192.168.201.58@tcp:58:dd.0 00010000:00010000:0.0:1784045450.164808:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.164825:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.164863:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045450.167683:0:14237:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045450.167882:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1784045450.167950:0:14237:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1784045450.168410:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+23:14447:x1870706808840448:12345-192.168.201.58@tcp:58:dd.0 Request processed in 3708us (9297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.168423:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1784045450.173295:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.173741:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840576 00000100:00100000:0.0:1784045450.173752:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840576 00000100:00100000:0.0:1784045450.173909:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784045450.173920:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+23:14447:x1870706808840576:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1784045450.173940:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045450.173959:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180025c expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.174034:0:15092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.174046:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 24 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.174065:0:15092:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.174078:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 24 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.174093:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:0.0:1784045450.174096:0:15092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045450.174100:0:15092:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 24 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.174107:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311ae00, rc 0) 00000100:00100000:0.0:1784045450.174159:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14447:x1870706808840576:12345-192.168.201.58@tcp:101:dd.0 Request processed in 242us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.174166:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000040:00080000:3.0:1784045450.273205:0:14270:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045450.273215:0:14270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045450.273251:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784045450.273258:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784045450.273390:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa939f4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14270:1870706829796096:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784045450.273497:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045450.277226:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa939f4df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14270:1870706829796096:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045450.277640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.277755:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840704 00000100:00100000:0.0:1784045450.277763:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840704 00000100:00100000:0.0:1784045450.277818:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784045450.277827:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808840704:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1784045450.277941:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808840704:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.277963:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784045450.286096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.286218:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840832 00000100:00100000:2.0:1784045450.286228:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840832 00000100:00100000:2.0:1784045450.286290:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784045450.286299:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808840832:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045450.286331:0:14238:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045450.286448:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808840832:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 149us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.286456:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1784045450.289061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.289149:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808840960 00000100:00100000:3.0:1784045450.289158:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808840960 00000100:00100000:3.0:1784045450.289213:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1784045450.289221:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808840960:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784045450.289302:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289318:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289347:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289364:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289371:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289378:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289401:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289410:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289417:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045450.289453:0:14236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784045450.289457:0:14236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784045450.289473:0:14236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289483:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289490:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289506:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289513:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045450.289517:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289532:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289544:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa9118c5a00) 00010000:00010000:3.0:1784045450.289548:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045450.289552:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289558:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e2df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289573:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289579:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289697:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289702:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045450.289705:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289722:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289741:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8aa92210cd00) 00010000:00010000:3.0:1784045450.289744:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045450.289748:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289753:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e2e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289769:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289775:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289781:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289786:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045450.289789:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289795:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289802:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:3.0:1784045450.289805:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045450.289807:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.289823:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e2ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045450.289941:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808840960:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 720us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045450.289949:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:1.0:1784045450.292914:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.293745:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808841216 00000100:00100000:2.0:1784045450.293757:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808841216 00000100:00100000:2.0:1784045450.293822:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:2.0:1784045450.293856:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+24:14448:x1870706808841216:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045450.293877:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045450.293910:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e2f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800263 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294010:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294026:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294038:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045450.294050:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784045450.294152:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294160:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294166:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294172:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720600 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:2.0:1784045450.294176:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294194:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294214:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:2.0:1784045450.294217:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784045450.294221:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294236:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e2fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294421:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e2f4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800263 expref: 26 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294434:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8aa9118c5a00) 00010000:00010000:2.0:1784045450.294437:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045450.294442:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e2f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800263 expref: 26 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.294453:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720e00, rc 0) 00000100:00100000:2.0:1784045450.294518:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+25:14448:x1870706808841216:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 687us (1613us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1784045450.294526:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784045450.297462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.297550:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808841344 00000100:00100000:3.0:1784045450.297559:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808841344 00000100:00100000:3.0:1784045450.297741:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1784045450.297752:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+25:14448:x1870706808841344:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045450.297788:0:14236:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045450.297912:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+25:14448:x1870706808841344:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 161us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045450.297920:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:1.0:1784045450.308953:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.309112:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808841600 00000100:00100000:0.0:1784045450.309122:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808841600 00000100:00100000:0.0:1784045450.309185:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:0.0:1784045450.309196:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+25:14448:x1870706808841600:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045450.309216:0:14237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045450.309236:0:14237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e309 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180026a expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045450.310053:0:14237:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1784045450.310061:0:14237:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1784045450.310112:0:14237:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1784045450.310430:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b200/0xdb5b5ff6a2d2e310 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.310444:0:14237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b200/0xdb5b5ff6a2d2e310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.310456:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b200/0xdb5b5ff6a2d2e310 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.310518:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311a600/0xdb5b5ff6a2d2e309 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180026a expref: 28 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.310538:0:14237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b200/0xdb5b5ff6a2d2e310 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180026a expref: 27 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.310546:0:14237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa9118c5000) 00010000:00010000:0.0:1784045450.310557:0:14237:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045450.310560:0:14237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311b200, rc 0) 00000100:00100000:0.0:1784045450.311546:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+27:14448:x1870706808841600:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2345us (2597us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1784045450.311556:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784045450.318786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.318939:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808841856 00000100:00100000:3.0:1784045450.318950:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808841856 00000100:00100000:3.0:1784045450.319014:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:3.0:1784045450.319025:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+27:14448:x1870706808841856:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045450.319085:0:14236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045450.319117:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311b200/0xdb5b5ff6a2d2e310 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180026a expref: 27 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319139:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa9118c5000) 00010000:00010000:3.0:1784045450.319151:0:14236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045450.319177:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319207:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319218:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319281:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319290:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319296:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319380:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319388:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319395:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319401:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173000 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045450.319405:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319413:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319421:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8aa9118c5500) 00010000:00010000:3.0:1784045450.319430:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045450.319435:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319440:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173000/0xdb5b5ff6a2d2e31e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319451:0:14236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319457:0:14236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319462:0:14236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319467:0:14236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942173200 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:3.0:1784045450.319470:0:14236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319476:0:14236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319485:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x85d25ce (ffff8aa92210cd00) 00010000:00010000:3.0:1784045450.319487:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045450.319491:0:14236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.319496:0:14236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942173200/0xdb5b5ff6a2d2e325 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x85d25ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045450.319594:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+26:14448:x1870706808841856:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 570us (816us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045450.319608:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:1.0:1784045450.322004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.322083:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808841984 00000100:00100000:2.0:1784045450.322092:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808841984 00000100:00100000:2.0:1784045450.322150:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1784045450.322159:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+26:14448:x1870706808841984:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045450.322177:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045450.322200:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e32c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800271 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.322235:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e333 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.322248:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e333 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.322273:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e333 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.322380:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e32c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800271 expref: 28 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.322398:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720600/0xdb5b5ff6a2d2e333 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800271 expref: 27 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.322406:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045450.322409:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045450.322413:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720600, rc 0) 00000100:00100000:2.0:1784045450.322468:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+27:14448:x1870706808841984:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 309us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.322475:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1784045450.324429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.324506:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808842240 00000100:00100000:3.0:1784045450.324515:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808842240 00000100:00100000:3.0:1784045450.324571:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:3.0:1784045450.324588:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+27:14448:x1870706808842240:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045450.324658:0:14236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.324673:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.324684:0:14236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045450.326025:0:14236:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1784045450.326038:0:14236:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 485012207714ns, next at 486012205362ns, rc = 0 00000004:00010000:3.0:1784045450.326129:0:14236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ced23ada reply state 0000000011b71969 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045450.326140:0:14236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045450.326242:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+29:14448:x1870706808842240:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1661us (1818us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1784045450.326251:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:1.0:1784045450.334403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.334483:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808842368 00000100:00100000:2.0:1784045450.334493:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808842368 00000100:00100000:2.0:1784045450.334564:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1784045450.334575:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+29:14448:x1870706808842368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045450.334607:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045450.334629:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800278 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.334693:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 30 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.334708:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 30 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.334755:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045450.334759:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045450.334762:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720c00, rc 0) 00000100:00100000:2.0:1784045450.334824:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+30:14448:x1870706808842368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 251us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.334854:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00010000:00010000:0.0:1784045450.335504:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.335514:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.335532:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.335537:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa942172400 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045450.335542:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.335549:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.335562:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:0.0:1784045450.335564:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784045450.335568:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.335573:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa942172400/0xdb5b5ff6a2d2e33a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.340233:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.340352:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808842496 00000100:00100000:2.0:1784045450.340362:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808842496 00000100:00100000:2.0:1784045450.340440:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784045450.340452:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2361:x1870706808842496:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784045450.341092:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2361:x1870706808842496:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 641us (865us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784045450.341114:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00080000:0.0:1784045450.341949:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045450.344433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.344691:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808842752 00000100:00100000:2.0:1784045450.344700:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808842752 00000100:00100000:2.0:1784045450.344785:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1784045450.344796:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+29:14448:x1870706808842752:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784045450.345036:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+30:14448:x1870706808842752:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 241us (609us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784045450.345044:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784045450.348916:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.348995:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808843008 00000100:00100000:0.0:1784045450.349018:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808843008 00000100:00100000:0.0:1784045450.349076:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784045450.349086:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+30:14448:x1870706808843008:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784045450.349193:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+30:14448:x1870706808843008:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 108us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.349201:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1784045450.351018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.351110:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808843136 00000100:00100000:2.0:1784045450.351117:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808843136 00000100:00100000:2.0:1784045450.351166:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784045450.351175:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+30:14448:x1870706808843136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045450.351203:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045450.351223:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e348 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180027f expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.351312:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e34f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.351408:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e34f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.351420:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e34f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045450.351458:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784045450.351475:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e34f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.351501:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720e00/0xdb5b5ff6a2d2e348 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180027f expref: 32 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.351519:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e34f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180027f expref: 31 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.351528:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:2.0:1784045450.351531:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784045450.351535:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa937720000, rc 0) 00000100:00100000:2.0:1784045450.351967:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+31:14448:x1870706808843136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 791us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.351975:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784045450.369952:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.370117:0:16011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808843264 00000100:00100000:0.0:1784045450.370128:0:16011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808843264 00000100:00100000:0.0:1784045450.370190:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1784045450.370201:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+6:2361:x1870706808843264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045450.370220:0:16011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045450.370241:0:16011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda05521800286 expref: -99 pid: 16011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045450.370268:0:16011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f8a, blocks: 0x1 00010000:00010000:0.0:1784045450.370315:0:16011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1784045450.370321:0:16011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045450.370330:0:16011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 7 pid: 16011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.370350:0:16011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 7 pid: 16011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.370364:0:16011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa80311a600, rc 0) 00000100:00100000:0.0:1784045450.370427:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2361:x1870706808843264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 228us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.370445:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784045450.379604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.379718:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808843520 00000100:00100000:0.0:1784045450.379736:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808843520 00000100:00100000:0.0:1784045450.379801:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1784045450.379812:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+31:14448:x1870706808843520:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784045450.379950:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+31:14448:x1870706808843520:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.379957:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1784045450.384643:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045450.384812:0:14237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808843648 00000100:00100000:1.0:1784045450.384822:0:14237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808843648 00000100:00100000:1.0:1784045450.384920:0:14237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:1.0:1784045450.384930:0:14237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+31:14448:x1870706808843648:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1784045450.479480:0:14237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+31:14448:x1870706808843648:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 94541us (94835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.479493:0:14237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000001:00080000:3.0:1784045450.479758:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1784045450.479800:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1784045450.479813:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1784045450.479821:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1784045450.479865:0:5826:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1784045450.479875:0:5826:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1784045450.480274:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045450.480293:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829796224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1784045450.480348:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045450.480504:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829796224 00000100:00100000:3.0:1784045450.480512:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829796224 00000100:00100000:3.0:1784045450.480576:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784045450.480593:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1870706829796224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1784045450.480751:0:14874:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784045450.480755:0:14874:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1784045450.480757:0:14874:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784045450.480759:0:14874:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1784045450 -> 1784045450 00002000:00010000:3.0:1784045450.480762:0:14874:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784045450.480803:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1870706829796224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 212us (455us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1784045450.480810:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1784045450.480868:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8aa93f679500/2, rc 0, transno 8589934595 00000100:00100000:3.0:1784045450.480874:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1870706829796224:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1784045450.481928:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045450.490153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.491414:0:16011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808843776 00000100:00100000:0.0:1784045450.491426:0:16011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808843776 00000100:00100000:0.0:1784045450.491498:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784045450.491508:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2360:x1870706808843776:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784045450.491646:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2360:x1870706808843776:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 138us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.491653:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784045450.509458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045450.509568:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844032 00000100:00100000:1.0:1784045450.509588:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844032 00000100:00100000:1.0:1784045450.509655:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:1.0:1784045450.509668:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:14448:x1870706808844032:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784045450.509969:0:15092:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045450.510004:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720000/0xdb5b5ff6a2d2e34f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180027f expref: 14 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.510024:0:15092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:1.0:1784045450.510029:0:15092:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045450.510061:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.510076:0:15092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.510085:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045450.510309:0:15092:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7a6d2c6 reply state 000000002cb7345e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.510327:0:15092:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784045450.510650:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+15:14448:x1870706808844032:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 985us (1202us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1784045450.510658:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:3.0:1784045450.517956:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045450.518048:0:14874:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844160 00000100:00100000:1.0:1784045450.518057:0:14874:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844160 00000100:00100000:1.0:1784045450.518115:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784045450.518125:0:14874:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:14448:x1870706808844160:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045450.518145:0:14874:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045450.518163:0:14874:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9edda0552180028d expref: -99 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.518214:0:14874:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.518224:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045450.518228:0:14874:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045450.518234:0:14874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 8 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.518269:0:14874:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.518292:0:14874:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.518307:0:14874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14874:1870706829796352:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784045450.518398:0:14874:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab780c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784045450.518480:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.518489:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.518496:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.518502:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031e00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:0.0:1784045450.518507:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.518528:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.518543:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:0.0:1784045450.518546:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045450.518551:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.518557:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900031e00/0xdb5b5ff6a2d2e35d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.522299:0:14874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14874:1870706829796352:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784045450.522335:0:14874:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 8 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.522356:0:14874:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8aa900030a00, rc 0) 00000100:00100000:1.0:1784045450.522418:0:14874:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+8:14448:x1870706808844160:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 4293us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045450.522444:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1784045450.525292:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.525493:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844288 00000100:00100000:2.0:1784045450.525503:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844288 00010000:00010000:2.0:1784045450.525557:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045450.525607:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784045450.525617:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+8:2360:x1870706808844288:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045450.525630:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045450.525651:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.525666:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.525700:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f923ed/0xdb5b5ff6a2d2e356 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800286 expref: 8 pid: 16011 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.525715:0:14222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045450.525719:0:14222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045450.525734:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 7 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.525762:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 7 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.525799:0:14222:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 7 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045450.525814:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14222:1870706829796480:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784045450.525931:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9088be540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045450.529790:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14222:1870706829796480:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784045450.529817:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045450.529915:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2360:x1870706808844288:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 4297us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.529925:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784045450.534696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.534866:0:16011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844416 00000100:00100000:0.0:1784045450.534877:0:16011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844416 00000100:00100000:0.0:1784045450.534936:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045450.534945:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2360:x1870706808844416:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784045450.535141:0:16011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784045450.535144:0:16011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784045450 00002000:00010000:0.0:1784045450.535146:0:16011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784045449 00002000:00010000:0.0:1784045450.535148:0:16011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1784045450 -> 1784045450 00002000:00010000:0.0:1784045450.535150:0:16011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784045450.535212:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+8:2360:x1870706808844416:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 267us (524us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784045450.535220:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1784045450.538777:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.538931:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844544 00000100:00100000:2.0:1784045450.538940:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844544 00000100:00100000:2.0:1784045450.538998:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1784045450.539009:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+8:2361:x1870706808844544:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784045450.539051:0:14875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.539072:0:14875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 8 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.539081:0:14875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045450.539101:0:14875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045450.539107:0:14875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.539144:0:14875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 8 pid: 14874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.539158:0:14875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 8 pid: 14874 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045450.539175:0:14875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14875:1870706829796608:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045450.539253:0:14875:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9088be540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045450.542879:0:14875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14875:1870706829796608:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045450.542910:0:14875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045450.543483:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.543537:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844672 00000100:00100000:0.0:1784045450.543545:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844672 00010000:00010000:0.0:1784045450.543590:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 9 pid: 14874 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.543651:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784045450.543660:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:2361:x1870706808844672:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045450.543674:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045450.543696:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 9 pid: 14874 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.543710:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 9 pid: 14874 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.543744:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f266ddf/0xdb5b5ff6a2d2e364 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x9edda0552180028d expref: 9 pid: 14874 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.543762:0:14223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045450.543765:0:14223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045450.543771:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.543780:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.543939:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045450.543984:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+8:2361:x1870706808844672:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 324us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.543992:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:1.0:1784045450.550533:0:14875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550553:0:14875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550604:0:14875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550613:0:14875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550621:0:14875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550628:0:14875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045450.550632:0:14875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550640:0:14875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550660:0:14875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.550691:0:14875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f4d895b/0xdb5b5ff6a2d2e36b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.550865:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2361:x1870706808844544:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 11851us (12089us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045450.550875:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1784045450.556482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.556534:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808844928 00000100:00100000:2.0:1784045450.556543:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808844928 00000100:00100000:2.0:1784045450.556617:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1784045450.556627:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:14448:x1870706808844928:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784045450.556710:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.556736:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.556749:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.557076:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.557090:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 15 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.557099:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.557138:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 15 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.557151:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 15 pid: 14238 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045450.557164:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1870706829796736:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784045450.557243:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9088be540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045450.563902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.564054:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1870706829796736:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784045450.564090:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.564760:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845056 00000100:00100000:0.0:1784045450.564768:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845056 00010000:00010000:0.0:1784045450.564804:0:14222:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 16 pid: 14238 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.564869:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784045450.564878:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+16:2360:x1870706808845056:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045450.564891:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045450.564898:0:14222:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 16 pid: 14238 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.564909:0:14222:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 16 pid: 14238 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.564930:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720c00/0xdb5b5ff6a2d2e341 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x9edda05521800278 expref: 16 pid: 14238 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.564944:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:0.0:1784045450.564949:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.564959:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.564966:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045450.564983:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045450.565035:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+15:2360:x1870706808845056:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 158us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.565051:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:1.0:1784045450.565116:0:14238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.565124:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045450.565307:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1784045450.565453:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1784045450.565500:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1784045450.565575:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1870706829796864:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784045450.565657:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045450.565686:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa941fb7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045450.566220:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829796864 00000100:00100000:0.0:1784045450.566226:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829796864 00000100:00100000:0.0:1784045450.566270:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045450.566279:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1870706829796864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784045450.566357:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1870706829796864:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.566364:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045450.566428:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1870706829796864:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1784045450.567114:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1784045450.567185:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1870706829796992:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784045450.567232:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045450.567256:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa90ab780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045450.567856:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829796992 00000100:00100000:0.0:1784045450.567862:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829796992 00000100:00100000:0.0:1784045450.567900:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045450.567908:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1870706829796992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784045450.568063:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14238:x1870706829796992:12345-0@lo:1000:mdt00_002.0 Request processed in 155us (830us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784045450.568070:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045450.568805:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93fca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14238:1870706829796992:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1784045450.568876:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568895:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568903:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568909:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045450.568913:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568920:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568935:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:1.0:1784045450.568938:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045450.568942:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568948:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937720800/0xdb5b5ff6a2d2e379 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568977:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568984:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568989:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.568994:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311bc00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045450.569004:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.569010:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.569019:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:1.0:1784045450.569022:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045450.569028:0:14238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.569039:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.569047:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.569076:0:14238:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311ae00/0xdb5b5ff6a2d2e2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x9edda0552180025c expref: 18 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.569089:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1870706829797120:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784045450.569158:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff8aa9125230c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045450.572288:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045450.572363:0:14240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845184 00000100:00100000:0.0:1784045450.572372:0:14240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845184 00000100:00100000:0.0:1784045450.572426:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784045450.572436:0:14240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14447:x1870706808845184:12345-192.168.201.58@tcp:49:dd.0 00000100:00100000:1.0:1784045450.572644:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14238:1870706829797120:192.168.201.58@tcp:105: 00010000:00010000:1.0:1784045450.572672:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572687:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa80311bc00/0xdb5b5ff6a2d2e2d1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14237 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572745:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572758:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572769:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572778:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572785:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572791:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572797:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030800 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045450.572801:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572808:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572818:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:1.0:1784045450.572822:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045450.572825:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572858:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030800/0xdb5b5ff6a2d2e380 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572875:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572882:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572888:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572893:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937721a00 already unused, calling callback (ffffffffc20fc4f0) 00010000:00010000:1.0:1784045450.572896:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572903:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572911:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8aa92210c700) 00010000:00010000:1.0:1784045450.572913:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784045450.572916:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.572922:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa937721a00/0xdb5b5ff6a2d2e372 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045450.577814:0:14240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e5d4df7-21bd-4c55-9ea9-223194ff0253+19:14447:x1870706808845184:12345-192.168.201.58@tcp:49:dd.0 Request processed in 5367us (5523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.577857:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000040:00080000:3.0:1784045450.578675:0:14270:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045450.578693:0:14270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045450.578746:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784045450.578752:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784045450.579885:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+18:14448:x1870706808844928:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 23255us (23408us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1784045450.579897:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000020:00080000:1.0:1784045450.579902:0:14238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1784045450.587327:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045450.587485:0:14239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845440 00000100:00100000:1.0:1784045450.587495:0:14239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845440 00000100:00100000:1.0:1784045450.587566:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784045450.587586:0:14239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+18:14448:x1870706808845440:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784045450.588327:0:14239:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784045450.588429:0:14239:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1784045450.588474:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.588490:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.588502:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.588511:0:14239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.588517:0:14239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.588524:0:14239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.588547:0:14239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045450.588604:0:14225:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045450.588611:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.588617:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045450.588620:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.588628:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.588641:0:14239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+20:14448:x1870706808845440:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1065us (1321us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1784045450.588642:0:14225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8aa902ec0f00) 00010000:00010000:3.0:1784045450.588645:0:14225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784045450.588650:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045450.588650:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000020:00080000:1.0:1784045450.588655:0:14239:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045450.588656:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8aa900030400/0xdb5b5ff6a2d2e387 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045450.588667:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045450.588669:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045450.588671:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045450.657078:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829797248:0@lo:400:kworker.0 00000100:00100000:0.0:1784045450.657104:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829797376:0@lo:400:kworker.0 00000100:00100000:3.0:1784045450.657202:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829797632:0@lo:400:kworker.0 00000100:00100000:0.0:1784045450.664689:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045450.664868:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045450.664925:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829797760:0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.664959:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045450.665000:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829797504:0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.665037:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045450.665068:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829797248 00000100:00100000:2.0:1784045450.665076:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829797248 00000100:00100000:2.0:1784045450.665121:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784045450.665130:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3321:x1870706829797248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.665183:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ecfa0ba9-cdb8-42f8-923d-132e8368012c+19:3321:x1870706829797248:12345-0@lo:400:kworker.0 Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.665190:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784045450.665223:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829797760 00000100:00100000:2.0:1784045450.665227:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829797760 00000100:00100000:2.0:1784045450.665259:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829797504 00000100:00100000:2.0:1784045450.665262:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829797504 00000100:00100000:2.0:1784045450.665298:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045450.665305:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829797760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.665349:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870706829797760:12345-0@lo:400:kworker.0 Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.665354:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045450.665366:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045450.665371:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.665399:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1870706829797504:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.665405:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1784045450.665422:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045450.665448:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1870706829797504:0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.665470:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ecfa0ba9-cdb8-42f8-923d-132e8368012c:3321:1870706829797248:0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.665479:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1870706829797760:0@lo:400:kworker.0 00000100:00100000:0.0:1784045450.666645:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829797888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045450.666696:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045450.668413:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829797888 00000100:00100000:0.0:1784045450.668424:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829797888 00000100:00100000:0.0:1784045450.668474:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045450.668483:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829797888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045450.668518:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784045450.668591:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1870706829797888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045450.668599:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045450.668651:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829797888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045450.668779:0:16011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829797376 00000100:00100000:1.0:1784045450.668785:0:16011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829797376 00000100:00100000:1.0:1784045450.668864:0:16011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045450.668875:0:16011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829797376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045450.668945:0:16011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829797376:12345-0@lo:400:kworker.0 Request processed in 73us (4262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045450.668954:0:16011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045450.668992:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829797376:0@lo:400:kworker.0 00000100:00080000:0.0:1784045450.669075:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045450.680227:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045450.681457:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829797632 00000100:00100000:2.0:1784045450.681469:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829797632 00000100:00100000:2.0:1784045450.681543:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045450.681552:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829797632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045450.681623:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1870706829797632:12345-0@lo:400:kworker.0 Request processed in 72us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045450.681630:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1784045450.681653:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045450.682065:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1870706829797632:0@lo:400:kworker.0 00000001:00080000:3.0:1784045450.767704:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1784045450.767755:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:0.0:1784045450.785134:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045450.823730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.823772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.823801:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.823965:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784045450.825518:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845568 00000100:00100000:2.0:1784045450.825530:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845568 00000100:00100000:2.0:1784045450.825583:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845696 00000100:00100000:2.0:1784045450.825586:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845696 00000100:00100000:2.0:1784045450.825601:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845824 00000100:00100000:2.0:1784045450.825604:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845824 00000100:00100000:2.0:1784045450.825623:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1784045450.825633:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+7:2362:x1870706808845568:12345-192.168.201.58@tcp:4:dd.0 00002000:00010000:2.0:1784045450.825683:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a565f8a, atime: 0x6a565f89, ctime: 0x6a565f8a, blocks: 0x1 00010000:00010000:2.0:1784045450.825693:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.825709:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1784045450.825714:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045450.825734:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045450.825749:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045450.828899:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.828919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.828934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784045450.828954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784045450.831962:0:14880:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045450.831979:0:14880:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784045450.834521:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808845952 00000100:00100000:2.0:1784045450.834534:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808845952 00000100:00100000:2.0:1784045450.834589:0:14880:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784045450.834599:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846080 00000100:00100000:2.0:1784045450.834602:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846080 00000100:00100000:2.0:1784045450.834616:0:14880:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784045450.834621:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846208 00000100:00100000:2.0:1784045450.834624:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846208 00000100:00100000:2.0:1784045450.834636:0:14880:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784045450.834642:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846336 00000100:00100000:2.0:1784045450.834645:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846336 00000100:00100000:2.0:1784045450.834658:0:14880:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784045450.834664:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846464 00000100:00100000:2.0:1784045450.834667:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846464 00000100:00100000:1.0:1784045450.835164:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:1.0:1784045450.835177:0:16367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+13:2363:x1870706808845696:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:1.0:1784045450.835214:0:16367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.835233:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045450.835238:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045450.835245:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045450.835260:0:16367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045451.015634:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1784045451.015993:0:14878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1784045451.015999:0:14878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1784045451.016026:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.016043:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.016054:0:14878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.016062:0:14878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045451.016978:0:14878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.017030:0:14878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.017060:0:14878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.017073:0:14878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5c5e7a/0xdb5b5ff6a2d2e38e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045451.017274:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+15:2362:x1870706808845568:12345-192.168.201.58@tcp:4:dd.0 Request processed in 191633us (193554us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1784045451.017287:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784045451.017334:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784045451.017349:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:2362:x1870706808845824:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1784045451.017391:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.017405:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.017411:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.017421:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.017436:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045451.092402:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1784045451.092574:0:16367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1784045451.092579:0:16367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1784045451.092598:0:16367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.092613:0:16367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.092623:0:16367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.092631:0:16367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900030800 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045451.092637:0:16367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.092648:0:16367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.092675:0:16367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.092684:0:16367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002be6e7a7/0xdb5b5ff6a2d2e395 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045451.093746:0:16367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+14:2363:x1870706808845696:12345-192.168.201.58@tcp:4:dd.0 Request processed in 257647us (269048us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784045451.093778:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784045451.093820:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1784045451.095417:0:16367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+13:2362:x1870706808845952:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1784045451.095474:0:16367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.095497:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.095502:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.095519:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.095535:0:16367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045451.142554:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1784045451.143116:0:14878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1784045451.143123:0:14878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1784045451.143143:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143160:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143170:0:14878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143179:0:14878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b600 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045451.143184:0:14878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143222:0:14878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143248:0:14878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143267:0:14878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdafb4b8/0xdb5b5ff6a2d2e39c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045451.143386:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+13:2362:x1870706808845824:12345-192.168.201.58@tcp:4:dd.0 Request processed in 126035us (319575us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784045451.143399:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784045451.143439:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1784045451.143453:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+12:2362:x1870706808846080:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:2.0:1784045451.143496:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143567:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045451.143574:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045451.143580:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.143596:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045451.191572:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1784045451.191689:0:16367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1784045451.191695:0:16367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1784045451.191724:0:16367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.191741:0:16367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.191769:0:16367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.191778:0:16367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:1.0:1784045451.191783:0:16367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.191794:0:16367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.192022:0:16367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.192033:0:16367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045451.192204:0:16367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+12:2362:x1870706808845952:12345-192.168.201.58@tcp:4:dd.0 Request processed in 98369us (368233us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1784045451.192216:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1784045451.192251:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784045451.192264:0:16367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+11:2362:x1870706808846208:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:1.0:1784045451.192304:0:16367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.192318:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045451.192329:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045451.192336:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045451.192350:0:16367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045451.256649:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1784045451.256868:0:14878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1784045451.256874:0:14878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1784045451.256894:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.256912:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.256924:0:14878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.256933:0:14878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa937720e00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045451.256953:0:14878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.256964:0:14878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.257001:0:14878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.257010:0:14878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce442690/0xdb5b5ff6a2d2e3aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045451.257156:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+11:2362:x1870706808846080:12345-192.168.201.58@tcp:4:dd.0 Request processed in 113701us (428257us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1784045451.257167:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1784045451.257209:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784045451.257224:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+10:2362:x1870706808846336:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1784045451.257271:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.257287:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.257292:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.257300:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.257315:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045451.295517:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1784045451.295662:0:16367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1784045451.295669:0:16367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1784045451.295687:0:16367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.295724:0:16367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.295735:0:16367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.295743:0:16367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa900031c00 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:0.0:1784045451.295749:0:16367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.295759:0:16367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.295786:0:16367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.295793:0:16367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025424c65/0xdb5b5ff6a2d2e3b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045451.295988:0:16367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92d056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+10:2362:x1870706808846208:12345-192.168.201.58@tcp:4:dd.0 Request processed in 103710us (467049us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1784045451.296022:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1784045451.296074:0:16367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784045451.296101:0:16367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa941fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:2362:x1870706808846464:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1784045451.296803:0:16367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.297044:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.297050:0:16367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045451.297058:0:16367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045451.297074:0:16367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045451.357472:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1784045451.357734:0:14878:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1784045451.357740:0:14878:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1784045451.357755:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045451.357768:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045451.357778:0:14878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045451.357786:0:14878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311b200 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:3.0:1784045451.357791:0:14878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045451.357801:0:14878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045451.357872:0:14878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045451.358128:0:14878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75989ab/0xdb5b5ff6a2d2e3b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045451.358222:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2e5d4df7-21bd-4c55-9ea9-223194ff0253+9:2362:x1870706808846336:12345-192.168.201.58@tcp:4:dd.0 Request processed in 100998us (529280us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784045451.358236:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000001:00080000:0.0:1784045451.406130:0:7510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:2.0:1784045451.406479:0:16367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1784045451.406494:0:16367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.406579:0:16367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.406589:0:16367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.406597:0:16367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8aa80311a400 already unused, calling callback (ffffffffc16f3230) 00010000:00010000:2.0:1784045451.406603:0:16367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.406612:0:16367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.406636:0:16367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.406644:0:16367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e772ab/0xdb5b5ff6a2d2e3bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045451.406860:0:16367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa941fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2362:x1870706808846464:12345-192.168.201.58@tcp:4:dd.0 Request processed in 110739us (577868us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784045451.406947:0:16367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00010000:00010000:3.0:1784045451.816796:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045452.193164:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045452.193187:0:3318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8aa93a0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829798016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045452.193267:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045452.193460:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706829798016 00000100:00100000:1.0:1784045452.193468:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706829798016 00000100:00100000:1.0:1784045452.193540:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784045452.193549:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829798016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045452.193580:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784045452.193621:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1870706829798016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045452.193628:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1784045452.193775:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045452.193808:0:3318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8aa93a0ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1870706829798016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045452.833989:0:14224:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045453.120432:0:16405:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1784045453.221933:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.221968:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.221992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.222017:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.222037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.222076:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.222114:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784045453.222140:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808847104 00000100:00100000:0.0:1784045453.222149:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808847104 00000100:00100000:0.0:1784045453.222207:0:14238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846720 00000100:00100000:0.0:1784045453.222211:0:14238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846720 00000100:00100000:0.0:1784045453.222247:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784045453.222257:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:2360:x1870706808847104:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045453.222331:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:261a809c-20e2-4e50-abff-b9519e12c29d+6:2360:x1870706808847104:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 76us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045453.222339:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784045453.222356:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784045453.222363:0:14238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+20:2360:x1870706808846720:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045453.222392:0:14238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa93fd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+20:2360:x1870706808846720:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045453.222398:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784045453.222419:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846848 00000100:00100000:0.0:1784045453.222422:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846848 00000100:00100000:0.0:1784045453.222441:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808847360 00000100:00100000:0.0:1784045453.222444:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808847360 00000100:00100000:0.0:1784045453.222455:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846976 00000100:00100000:0.0:1784045453.222458:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846976 00000100:00100000:0.0:1784045453.222467:0:14875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808847232 00000100:00100000:0.0:1784045453.222469:0:14875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808847232 00000100:00100000:0.0:1784045453.222482:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784045453.222487:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2360:x1870706808846848:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045453.222513:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2360:x1870706808846848:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045453.222526:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784045453.222538:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045453.222544:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa937d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:2360:x1870706808847360:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045453.222569:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa937d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:2360:x1870706808847360:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045453.222575:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784045453.222586:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784045453.222592:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2360:x1870706808846976:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045453.222615:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e5d4df7-21bd-4c55-9ea9-223194ff0253+5:2360:x1870706808846976:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045453.222620:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784045453.222631:0:14875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784045453.222636:0:14875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:2360:x1870706808847232:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784045453.222656:0:14875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa939f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:261a809c-20e2-4e50-abff-b9519e12c29d+5:2360:x1870706808847232:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045453.222662:0:14875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00080000:0.0:1784045453.222699:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045453.222703:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045453.222705:0:14232:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045453.222986:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706808846592 00000100:00100000:1.0:1784045453.222991:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706808846592 00000100:00100000:1.0:1784045453.223027:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:1.0:1784045453.223034:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8aa92ce9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:2360:x1870706808846592:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784045453.223066:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8aa92ce9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9601e793-9924-4b38-b573-084004e89c20+13:2360:x1870706808846592:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045453.223073:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00010000:00010000:3.0:1784045453.863974:0:14225:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29593 lines, 29593 kept, 0 dropped, 0 bad.